Found 224 jobs Misunderstood line: Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Ignoring malparsed backtrace: ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f4ef90f6257] , 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f4ef90f6413] Ignoring malparsed backtrace: 2023-05-20T09:35:14.602+0000 7f18332b2700 1 -- start start , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f182c065d00 0x7f182c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:14.602+0000 7f18332b2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f182c06c7b0 0x7f182c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:14.922+0000 7f24a1e70700 1 -- 172.21.15.177:0/3851621859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1463d0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 -- 172.21.15.177:0/3851621859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f249401b3b0 con 0x7f249c13ccb0 , 2023-05-20T09:35:14.926+0000 7f24917fa700 1 --2- 172.21.15.177:0/3851621859 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f2488066320 0x7f24880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 Processor -- start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 -- start start , 2023-05-20T09:35:15.550+0000 7f6d19a4a700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f6d140b89f0 0x7f6d140b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be40035d0 con 0x7f4bf80b5d10 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 <== mon.1 v1:172.21.15.193:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497557174 0 0) 0x7f4bf80b52a0 con 0x7f4bf80b41d0 , 2023-05-20T09:35:15.874+0000 7f4bfd091700 1 -- 172.21.15.177:0/759383277 --> v1:172.21.15.193:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80b28d0 con 0x7f4bf80b41d0 Ignoring malparsed backtrace: 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400e070 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400bbd0 con 0x7f7a2c0b2320 , 2023-05-20T09:35:16.178+0000 7f7a2959a700 1 -- 172.21.15.177:0/3772392256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012430 con 0x7f7a2c0b2320 Ignoring malparsed backtrace: 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:16.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.450 INFO:teuthology.orchestra.run.smithi177.stdout: "smtp_password": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", , 2023-05-20T09:35:16.470 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "This is a time of day in the format HHMM.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:16.490 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.511 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.530 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.531 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.550 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.570 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.571 INFO:teuthology.orchestra.run.smithi177.stdout: "container_image_jaeger_query": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", , 2023-05-20T09:35:16.664 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", Ignoring malparsed backtrace: 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.706 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "Prometheus web password", Ignoring malparsed backtrace: 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:16.731 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.732 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.753 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.802 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.825 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:16.826 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", , 2023-05-20T09:35:16.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:16.897 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:16.917 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:16.938 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ssl_server_port": { Ignoring malparsed backtrace: 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:16.979 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.000 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", , 2023-05-20T09:35:17.001 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.021 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", , 2023-05-20T09:35:17.041 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.081 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.164 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:17.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.205 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.206 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:17.226 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.227 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.250 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.251 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", , 2023-05-20T09:35:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", , 2023-05-20T09:35:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", Ignoring malparsed backtrace: 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", , 2023-05-20T09:35:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { , 2023-05-20T09:35:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "contact", Ignoring malparsed backtrace: 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:17.539 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { , 2023-05-20T09:35:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "volumes", Ignoring malparsed backtrace: 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: } Ignoring malparsed backtrace: 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: ], , 2023-05-20T09:35:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", Ignoring malparsed backtrace: 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.684 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "beginning time of day to automatically balance", Ignoring malparsed backtrace: 2023-05-20T09:35:17.704 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:17.705 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "pools which the automatic balancing will be limited to", , 2023-05-20T09:35:17.725 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "admin", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.746 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.766 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "manage configs like API endpoints in Dashboard.", , 2023-05-20T09:35:17.767 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:17.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:17.808 INFO:teuthology.orchestra.run.smithi177.stdout: "container_init": { , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "container_init", , 2023-05-20T09:35:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "600", Ignoring malparsed backtrace: 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.850 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.871 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "cephadm service discovery port", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.891 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], Ignoring malparsed backtrace: 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:17.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "int", , 2023-05-20T09:35:17.933 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:17.953 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:17.954 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:17.974 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:17.994 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:17.995 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { , 2023-05-20T09:35:18.015 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", Ignoring malparsed backtrace: 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.056 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "how frequently to scrape device health metrics", Ignoring malparsed backtrace: 2023-05-20T09:35:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": { , 2023-05-20T09:35:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "hostname", Ignoring malparsed backtrace: 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" Ignoring malparsed backtrace: 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", , 2023-05-20T09:35:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "error", , 2023-05-20T09:35:18.263 INFO:teuthology.orchestra.run.smithi177.stdout: "info", Ignoring malparsed backtrace: 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.304 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.305 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster_level": { , 2023-05-20T09:35:18.325 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster_level", Ignoring malparsed backtrace: 2023-05-20T09:35:18.345 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "info", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.346 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [], , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "desc": "", , 2023-05-20T09:35:18.367 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.387 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "60", , 2023-05-20T09:35:18.388 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "enum_allowed": [ , 2023-05-20T09:35:18.408 INFO:teuthology.orchestra.run.smithi177.stdout: "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.429 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", , 2023-05-20T09:35:18.430 INFO:teuthology.orchestra.run.smithi177.stdout: "error", Ignoring malparsed backtrace: 2023-05-20T09:35:18.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "server_addr": { , 2023-05-20T09:35:18.451 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "server_addr", Ignoring malparsed backtrace: 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "log_to_cluster": { , 2023-05-20T09:35:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "bool", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", , 2023-05-20T09:35:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: "max": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.534 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "roption1", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.535 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "True", , 2023-05-20T09:35:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "log_level": { , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "log_level", , 2023-05-20T09:35:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", Ignoring malparsed backtrace: 2023-05-20T09:35:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, , 2023-05-20T09:35:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "critical", , 2023-05-20T09:35:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "debug", Ignoring malparsed backtrace: 2023-05-20T09:35:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "contact": { Ignoring malparsed backtrace: 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "leaderboard_description", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "str", , 2023-05-20T09:35:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 0, , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "default_value": "", , 2023-05-20T09:35:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "min": "", Ignoring malparsed backtrace: 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: } , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: { Ignoring malparsed backtrace: 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "long_desc": "", , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "tags": [], , 2023-05-20T09:35:18.743 INFO:teuthology.orchestra.run.smithi177.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "info", , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: "warning" , 2023-05-20T09:35:18.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], Ignoring malparsed backtrace: 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "status", , 2023-05-20T09:35:18.785 INFO:teuthology.orchestra.run.smithi177.stdout: "telemetry", , 2023-05-20T09:35:18.786 INFO:teuthology.orchestra.run.smithi177.stdout: "volumes" Ignoring malparsed backtrace: 2023-05-20T09:35:18.929 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 41073, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 40621, , 2023-05-20T09:35:18.930 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10273900, Ignoring malparsed backtrace: 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, , 2023-05-20T09:35:18.950 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 27148, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 36.509769317, , 2023-05-20T09:35:18.971 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001344841 Ignoring malparsed backtrace: 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.220781884, , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010035540 , 2023-05-20T09:35:18.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, Ignoring malparsed backtrace: 2023-05-20T09:35:19.011 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, , 2023-05-20T09:35:19.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.031 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 81316 , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, , 2023-05-20T09:35:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { Ignoring malparsed backtrace: 2023-05-20T09:35:19.053 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 , 2023-05-20T09:35:19.053 DEBUG:tasks.check_counter:Getting stats from b , 2023-05-20T09:35:19.054 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump Ignoring malparsed backtrace: 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, , 2023-05-20T09:35:19.195 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, Ignoring malparsed backtrace: 2023-05-20T09:35:19.350+0000 7f4bc117e700 1 -- 172.21.15.177:0/544481647 learned_addr learned my addr 172.21.15.177:0/544481647 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:19.350+0000 7f4bc197f700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4bbc0b4270 0x7f4bbc1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:19.350+0000 7f4bc2180700 1 --2- 172.21.15.177:0/544481647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bbc146890 0x7f4bbc136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 -- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 msgr2=0x7f77040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:19.874+0000 7f771c81e700 1 --2- 172.21.15.177:0/470909506 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f77040662f0 0x7f77040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c009240 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44ec14b170 0x7f44ec14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55904/0 (socket says 172.21.15.177:55904) , 2023-05-20T09:35:20.330+0000 7f44f2bcd700 1 -- 172.21.15.177:0/3431793409 learned_addr learned my addr 172.21.15.177:0/3431793409 (peer_addr_for_me v2:172.21.15.177:0/0) , 2023-05-20T09:35:20.330+0000 7f44f1bcb700 1 --2- 172.21.15.177:0/3431793409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44ec13c770 0x7f44ec13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0bbd70 con 0x7f15ec13fae0 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec140c50 con 0x7f15ec140770 , 2023-05-20T09:35:21.674+0000 7f15ebfff700 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1db0f0 con 0x7f15ec13feb0 Ignoring malparsed backtrace: 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:21.842+0000 7f409a59c700 1 --2- 172.21.15.177:0/2327381893 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f407c0662f0 0x7f407c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:21.842+0000 7f4092ffd700 1 -- 172.21.15.177:0/2327381893 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4094083610 con 0x7f409c0b4480 Ignoring malparsed backtrace: 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- start start , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbba4065d00 0x7fbba40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:22.310+0000 7fbbaa5e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143530 con 0x7fbba40aef00 Ignoring malparsed backtrace: 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ada10 con 0x7f8a38006a80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b3060 con 0x7f8a38005c80 , 2023-05-20T09:35:22.626+0000 7f8a477fe700 1 -- 172.21.15.177:0/254207323 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3800e280 con 0x7f8a38007430 Ignoring malparsed backtrace: 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc40b8070 0x7f2dc413be50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 --2- 172.21.15.177:0/4259975992 >> v2:172.21.15.193:3300/0 conn(0x7f2dc40b0aa0 0x7f2dc40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:22.790+0000 7f2dca0b3700 1 -- 172.21.15.177:0/4259975992 >> 172.21.15.177:0/4259975992 conn(0x7f2dc40b50b0 msgr2=0x7f2dc40b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005430 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a5a0bc700 1 -- 172.21.15.177:0/207001631 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540b5f70 con 0x7f4a540b12c0 , 2023-05-20T09:35:23.118+0000 7f4a45ffb700 1 -- 172.21.15.177:0/207001631 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500055a0 con 0x7f4a540b12c0 Ignoring malparsed backtrace: 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 -- 172.21.15.177:0/3162639526 shutdown_connections , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] conn(0x7f92480662f0 0x7f92480687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:23.450+0000 7f926ce2a700 1 --2- 172.21.15.177:0/3162639526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f92680b7f50 0x7f9268140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:23.750+0000 7f7d137fe700 1 --2- 172.21.15.177:0/2119017345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1413ffc0 0x7f7d140b4f50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009910 tx=0x7f7cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50e1c11ceb1c69 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ba60 con 0x7f7d1413ffc0 , 2023-05-20T09:35:23.750+0000 7f7d12ffd700 1 -- 172.21.15.177:0/2119017345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bbc0 con 0x7f7d1413ffc0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.066+0000 7f99397bf700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9934142260 0x7f99340bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 -- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 msgr2=0x7f99341412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:35:24.070+0000 7f9933fff700 1 --2- 172.21.15.177:0/2991645822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f993413fae0 0x7f99341412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-05-20T09:35:24.230+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38600524e0 con 0x7f386414c250 , 2023-05-20T09:35:24.402+0000 7f386a6db700 1 -- 172.21.15.177:0/4021188412 --> [v2:172.21.15.177:6832/561694264,v1:172.21.15.177:6833/561694264] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38641de8f0 con 0x7f38480662f0 , 2023-05-20T09:35:24.402+0000 7f3859ffb700 1 -- 172.21.15.177:0/4021188412 <== mgr.4103 v2:172.21.15.177:6832/561694264 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38641de8f0 con 0x7f38480662f0 Ignoring malparsed backtrace: 2023-05-20T09:35:24.686+0000 7f2c69044700 1 -- start start , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 --2- >> v2:172.21.15.193:3300/0 conn(0x7f2c640717c0 0x7f2c64146890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-05-20T09:35:24.690+0000 7f2c69044700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b1bf0 con 0x7f2c6413cd20 Ignoring malparsed backtrace: 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 shutdown_connections , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 -- 172.21.15.177:0/2665881366 wait complete. , 2023-05-20T09:35:25.014+0000 7f5f2503b700 1 Processor -- start Ignoring malparsed backtrace: 2023-05-20T09:35:25.182+0000 7fba61cfd700 1 --2- 172.21.15.177:0/3911876096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba5c13c820 0x7fba5c141630 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fba4c014040 tx=0x7fba4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009e60 con 0x7fba5c13c820 , 2023-05-20T09:35:25.182+0000 7fba52ffd700 1 -- 172.21.15.177:0/3911876096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01e070 con 0x7fba5c13c820 Ignoring malparsed backtrace: 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 --2- 172.21.15.177:0/1291903680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dc406a0f0 0x7f2dc40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 >> 172.21.15.177:0/1291903680 conn(0x7f2dc40b54a0 msgr2=0x7f2dc406d660 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-05-20T09:35:25.714+0000 7f2dc96f8700 1 -- 172.21.15.177:0/1291903680 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.769 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-20T09:24:01.515557+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=1, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:25.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) , 2023-05-20T09:35:46.142 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-20T09:24:02.519647+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=24, tm_sec=2, tm_wday=5, tm_yday=140, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=20, tm_hour=9, tm_min=35, tm_sec=20, tm_wday=5, tm_yday=140, tm_isdst=0) Ignoring malparsed backtrace: 2023-05-20T09:36:06.288+0000 7f0f05012700 1 --2- 172.21.15.177:0/2211955656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f000b44d0 0x7f0f001440f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c730 tx=0x7f0efc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:06.288+0000 7f0ef5ffb700 1 -- 172.21.15.177:0/2211955656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005d90 con 0x7f0f000b44d0 , 2023-05-20T09:36:06.288+0000 7f0f06014700 1 -- 172.21.15.177:0/2211955656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000b5190 con 0x7f0f000b44d0 Ignoring malparsed backtrace: 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 msgr2=0x7fafd4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 --2- 172.21.15.177:0/2529805282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafd40b0aa0 0x7fafd4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-05-20T09:36:26.676+0000 7fafd2ffd700 1 -- 172.21.15.177:0/2529805282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009a70 con 0x7fafd413be50 Ignoring malparsed backtrace: 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 msgr2=0x7fc55813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 --2- 172.21.15.177:0/2210972123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55813c3c0 0x7fc55813a050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c430 tx=0x7fc55000c740 comp rx=0 tx=0).stop , 2023-05-20T09:36:47.215+0000 7fc55ece4700 1 -- 172.21.15.177:0/2210972123 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:47.715+0000 7fb19ad9d700 1 --2- 172.21.15.177:0/3999987436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb19c0b82e0 0x7fb19c143050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb190009850 tx=0x7fb190009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef59c2f021865 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb19c0b82e0 , 2023-05-20T09:36:47.715+0000 7fb199d9b700 1 -- 172.21.15.177:0/3999987436 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb190004030 con 0x7fb19c0b82e0 Ignoring malparsed backtrace: 2023-05-20T09:36:48.067+0000 7f7541c4d700 1 -- 172.21.15.177:0/3190618674 reap_dead start , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 shutdown_connections , 2023-05-20T09:36:48.067+0000 7f754244e700 1 -- 172.21.15.177:0/3190618674 >> 172.21.15.177:0/3190618674 conn(0x7f753c0b50b0 msgr2=0x7f753c0b7960 unknown :-1 s=STATE_NONE l=0).mark_down Ignoring malparsed backtrace: 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a80045a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00b6dcc700 1 -- 172.21.15.177:0/3156594169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006e6a0 con 0x7f00b014c250 , 2023-05-20T09:36:48.407+0000 7f00a67fc700 1 -- 172.21.15.177:0/3156594169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004970 con 0x7f00b014c250 Ignoring malparsed backtrace: 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 shutdown_connections , 2023-05-20T09:36:48.947+0000 7f4f42b95700 1 -- 172.21.15.177:0/3075035779 wait complete. , cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. Ignoring malparsed backtrace: 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 msgr2=0x7f7ef40b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 --2- 172.21.15.177:0/1991490852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ef40b4160 0x7f7ef40b5ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec00b330 comp rx=0 tx=0).stop , 2023-05-20T09:36:49.443+0000 7f7ef3fff700 1 -- 172.21.15.177:0/1991490852 shutdown_connections Ignoring malparsed backtrace: 2023-05-20T09:36:50.779+0000 7f2ce259c700 1 --2- 172.21.15.177:0/853158450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce40b28d0 0x7f2ce4149010 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ebe0 tx=0x7f2cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009790 con 0x7f2ce40b28d0 , 2023-05-20T09:36:50.779+0000 7f2cdaffd700 1 -- 172.21.15.177:0/853158450 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cd400c850 con 0x7f2ce40b28d0 Ignoring malparsed backtrace: 2023-05-20T09:37:06.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com , 2023-05-20T09:37:06.601 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 , 2023-05-20T09:37:06.794 INFO:tasks.ceph:Archiving mon data... Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log , 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz , /var/log/ceph/ceph-client.admin.40398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log , /var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log , 93.2%/var/log/ceph/ceph-client.admin.34356.log: -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log , /var/log/ceph/ceph-client.admin.63322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log Found 30 distinct failure reasons Failure: reached maximum tries (50) after waiting for 300 seconds 1 jobs: ['7279547'] suites: ['1-ceph', '2-logrotate}', 'cephfs-mirror/three-per-cluster', 'clients/{mirror}', 'cluster/{1-node}', 'fs/mirror-ha/{begin/{0-install', 'objectstore/bluestore-bitmap', 'overrides/{whitelist_health}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/cephfs-mirror-ha-workunit}'] Crash: Command failed on smithi046 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i'" ceph version 18.0.0-4092-gf704846c (f704846cae03d45131067a3ffbcec6231d97621a) reef (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f98b3ba1ce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f98b499ce19] 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f98b499cf85] 6: (Client::add_update_cap(Inode*, MetaSession*, unsigned long, unsigned int, unsigned int, unsigned int, unsigned int, inodeno_t, int, UserPerm const&)+0xc53) [0x55ce2ef7f2f3] 7: (Client::add_update_inode(InodeStat*, utime_t, MetaSession*, UserPerm const&)+0x943) [0x55ce2ef806c3] 8: (Client::insert_trace(MetaRequest*, MetaSession*)+0xd6e) [0x55ce2ef83b3e] 9: (Client::handle_client_reply(boost::intrusive_ptr const&)+0x3a0) [0x55ce2ef84900] 10: (Client::ms_dispatch2(boost::intrusive_ptr const&)+0x58d) [0x55ce2efa7c0d] 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f98b4c15f58] 12: (DispatchQueue::entry()+0x50f) [0x7f98b4c130ff] 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f98b4cd9451] 14: /lib64/libpthread.so.0(+0x81cf) [0x7f98b3b971cf] 15: clone() 2 jobs: ['7279655', '7279559'] suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'osd}'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '2-workunit/fs/snaps}}', '3-snaps/no', '4-flush/no', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'frag', 'fs/thrash/workloads/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'n/5', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-quota}', 'tasks/{1-thrash/mds', 'thrashosds-health}'] Valgrind: mon (InvalidRead, Leak_PossiblyLost, Leak_StillReachable) 1 jobs: ['7279556'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/1', 'session_timeout}', 'tasks/fsstress', 'validater/valgrind}'] Failure: Cannot connect to remote host smithi070 8 jobs: ['7279656', '7279666', '7279575', '7279721', '7279704', '7279648', '7279531', '7279720'] suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}'] suites union: ['1-cephadm', '1-check-counter', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-logrotate}', '2-scrub/no', '2-scrub/yes', '3-inline/no', '3-inline/yes', '3-snaps/no', '3-snaps/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-flush/no', '4-flush/yes', '4-verify}', '5-upgrade-with-workload', '5-workunit/kernel_untar_build}}', '5-workunit/suites/blogbench}}', '5-workunit/suites/pjd}}', '6-verify}}', 'begin/{0-install', 'centos_8.stream_container_tools', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fail_fs/no', 'fail_fs/yes', 'frag', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/legacy', 'ms_mode/secure', 'n/3', 'n/5', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn', 'ranks/multi/{export-check', 'replication/default}', 'rhel_8}', 'roles', 'session_timeout}', 'standby-replay', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'tasks/{0-subvolume/{with-quota}', 'wsync/no}', 'wsync/yes}'] Failure: Test failure: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc), test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2 jobs: ['7279661', '7279548'] suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{ignorelist_health', 'tasks/cephfs_misc_tests}'] suites union: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/cephfs_misc_tests}'] Failure: Test failure: test_journal_migration (tasks.cephfs.test_journal_migration.TestJournalMigration), test_journal_migration (tasks.cephfs.test_journal_migration.TestJournalMigration) 1 jobs: ['7279563'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/test_journal_migration}'] Failure: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2 jobs: ['7279515', '7279705'] suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/quota}'] suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/quota}'] Failure: Command failed (workunit test fs/quota/quota.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 1 jobs: ['7279582'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] Timeout 6h running clone.client.0/qa/workunits/suites/fsstress.sh 2 jobs: ['7279686', '7279578'] suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/testing/k-testing'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '2-workunit/suites/fsstress}}', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/fsstress}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'frag', 'fs/thrash/workloads/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'msgr-failures/osd-mds-delay', 'n/5', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/3', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated}', 'tasks/{1-thrash/osd', 'thrashosds-health}', 'wsync/yes}'] Failure: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 1 jobs: ['7279577'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] Timeout 6h running clone.client.0/qa/workunits/suites/pjd.sh 2 jobs: ['7279609', '7279676'] suites intersection: ['1-ceph', '2-logrotate}', '2-workunit/suites/pjd}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_entire_dirfrags/no', 'races', 'ranks/3', 'session_timeout', 'thrashosds-health}'] suites union: ['1-ceph', '2-logrotate}', '2-workunit/suites/pjd}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'races', 'ranks/3', 'session_timeout', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'thrashosds-health}'] Failure: Test failure: test_migrate_unlinked_dir (tasks.cephfs.test_strays.TestStrays), test_migrate_unlinked_dir (tasks.cephfs.test_strays.TestStrays) 1 jobs: ['7279560'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/strays}'] Failure: Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f704846cae03d45131067a3ffbcec6231d97621a pull' 2 jobs: ['7279629', '7279698'] suites intersection: ['2-logrotate}', 'conf/{client', 'mds', 'mon', 'objectstore-ec/bluestore-bitmap', 'osd}'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/iozone}}', 'begin/{0-install', 'clusters/1-mds-2-client', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distros/ubuntu_latest', 'frag', 'fs/multiclient/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/5', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/ior-shared-file}', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/yes}'] Failure: SSH connection to smithi088 was lost: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i'" 4 jobs: ['7279570', '7279509', '7279588', '7279624'] suites intersection: ['2-logrotate}', 'conf/{client', 'mds', 'mon', 'osd}'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/yes', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distros/ubuntu_latest', 'frag', 'fs/multiclient/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'n/5', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/ior-shared-file}', 'tasks/mdtest}', 'tasks/{0-subvolume/{with-quota}', 'wsync/yes}'] Failure: error during scrub thrashing: rank damage found: {'backtrace'} 1 jobs: ['7279562'] suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/yes', '5-workunit/fs/misc}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/3', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/yes}'] Failure: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan), test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 1 jobs: ['7279643'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/data-scan}'] Timeout 3h running clone.client.0/qa/workunits/suites/dbench.sh 4 jobs: ['7279596', '7279584', '7279671', '7279683'] suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'osd}', 'session_timeout}'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '2-scrub/yes', '3-snaps/no', '3-snaps/yes', '4-flush/no', '4-flush/yes', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu/{latest', 'frag', 'fs/verify/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'ms_mode/secure', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/1', 'ranks/3', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/dbench', 'tasks/{0-subvolume/{no-subvolume}', 'tasks/{0-subvolume/{with-no-extra-options}', 'validater/lockdep}', 'validater/valgrind}', 'wsync/no}', 'wsync/yes}'] Failure: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 1 jobs: ['7279543'] suites: ['1-ceph', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/v1', 'osd}', 'overrides/{distro/testing/k-testing}}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/fscrypt-common}'] Failure: "1684569539.7290437 mon.a (mon.0) 8246 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 1 jobs: ['7279510'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/multifs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/failover}'] Failure: Command failed (workunit test fs/test_python.sh) on smithi177 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 1 jobs: ['7279716'] suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs_python}'] Failure: Test failure: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery), test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 1 jobs: ['7279631'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/client-recovery}'] Timeout 3h running clone.client.1/qa/workunits/suites/dbench.sh 2 jobs: ['7279695', '7279572'] suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'ms-die-on-skipped}', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'tasks/kernel_cfuse_workunits_dbench_iozone}'] suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/stock/{k-stock', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/kernel_cfuse_workunits_dbench_iozone}'] Failure: Command failed on smithi176 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b4dc196-f6db-11ed-9b02-001a4aab830c -- ceph orch daemon add osd smithi176:vg_nvme/lv_4' 1 jobs: ['7279513'] suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4'] Failure: Command failed (workunit test fs/fscrypt.sh) on smithi155 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt.sh none ffsb' 2 jobs: ['7279640', '7279597'] suites intersection: ['1-ceph', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/v1', 'osd}', 'overrides/{distro/testing/k-testing}}', 'overrides/{ignorelist_health', 'pg-warn}'] suites union: ['1-ceph', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/v1', 'osd}', 'overrides/{distro/testing/k-testing}}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/fscrypt-dbench}', 'tasks/fscrypt-ffsb}'] Failure: Test failure: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable), test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 1 jobs: ['7279692'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/openfiletable}'] Failure: Command failed (workunit test kernel_untar_build.sh) on smithi112 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 1 jobs: ['7279526'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}'] Failure: Command failed (workunit test libcephfs/test.sh) on smithi177 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 1 jobs: ['7279660'] suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs/{frag', 'test}}'] Failure: Command failed (workunit test suites/ffsb.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 1 jobs: ['7279675'] suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/ffsb}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/3', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'wsync/yes}'] Failure: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi043 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh' 1 jobs: ['7279664'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/snaps/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/snaps}'] Failure: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f704846cae03d45131067a3ffbcec6231d97621a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 1 jobs: ['7279621'] suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health}']