Found 197 jobs Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s Missing teuthology log /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362573/teuthology.log Misunderstood line: Found 21 distinct failure reasons Failure: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 1 jobs: ['7362592'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] Failure: Command failed (workunit test suites/iozone.sh) on smithi079 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/iozone.sh' 1 jobs: ['7362637'] suites: ['1-ceph', '2-logrotate}', '2-workunit/iozone}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/thrash/multifs/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] Failure: Command failed on smithi142 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 5 jobs: ['7362684', '7362713', '7362619', '7362587', '7362745'] suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{ignorelist_health'] suites union: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'clusters/1-node-1-mds-1-osd', 'conf/{client', 'distro/{rhel_8}', 'distros/ubuntu_latest', 'fs/full/{begin/{0-install', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides', 'overrides/{ignorelist_health', 'tasks/ior-shared-file}', 'tasks/mdtest}', 'tasks/mgr-osd-full}'] Dead: b'2023-08-09T02:24:27.298 DEBUG:teuthology.exit:Finished running handlers' 5 jobs: ['7362714', '7362759', '7362585', '7362653', '7362588'] suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_20.04}', 'distro/{ubuntu_latest}', 'frag', 'fs/functional/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'n/3', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'ranks/multi/{export-check', 'replication/always}', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/multifs-auth}', 'tasks/xfstests-dev}', 'tasks/{0-subvolume/{with-quota}', 'wsync/yes}'] Failure: Command failed (workunit test libcephfs/test.sh) on smithi107 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 1 jobs: ['7362651'] suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs/{frag', 'test}}'] Dead: None 6 jobs: ['7362573', '7362699', '7362645', '7362758', '7362625', '7362597'] Failure: Command failed (workunit test suites/dbench.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 1 jobs: ['7362608'] suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}', 'wsync/yes}'] Failure: Command failed (workunit test fs/quota/quota.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh' 2 jobs: ['7362596', '7362764'] suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] Failure: Command failed on smithi181 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib' 2 jobs: ['7362584', '7362583'] suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'osd}'] suites union: ['1-ceph', '2-logrotate}', '2-workunit/fs/trivial_sync}}', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'no_client_pidfile}', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag', 'overrides/{ignorelist_health', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'races', 'ranks/5', 'session_timeout', 'tasks/truncate_delay}', 'tasks/{1-thrash/mds', 'thrashosds-health}'] Failure: Command failed (workunit test kernel_untar_build.sh) on smithi175 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 3 jobs: ['7362681', '7362730', '7362572'] suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/kernel_untar_build}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'frag', 'fs/mixed-clients/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd-asserts}', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/1', 'session_timeout}', 'standby-replay', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/{0-subvolume/{with-namespace-isolated}', 'wsync/yes}'] Failure: No module named 'tasks.ceph' 7 jobs: ['7362582', '7362578', '7362579', '7362569', '7362581', '7362604', '7362603'] suites intersection: ['conf/{client', 'mds', 'mon', 'osd}'] suites union: ['1-ceph', '1-client-sanity}}}', '1-mount/mount/fuse', '2-logrotate}', '2-workload/new_ops/{0-clients/fuse-upgrade', '2-workunit/suites/fsstress}}', 'centos_8', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'clusters/{1-mds-1-client-micro}', 'conf/{client', 'distro/{centos_8}', 'distro/{centos_latest}', 'distro/{rhel_8}', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'fs/permission/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/upgrade/upgraded_client/{bluestore-bitmap', 'fs/volumes/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'overrides/{ignorelist_health', 'pg-warn}', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/3', 'rhel_8}', 'session_timeout', 'tasks/admin}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/test_journal_migration}', 'tasks/volumes/{overrides', 'tasks/{0-from/nautilus', 'tasks/{1-thrash/osd', 'test/clone}}', 'thrashosds-health}'] Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 1 jobs: ['7362755'] suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] Failure: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 1 jobs: ['7362683'] suites: ['1-ceph', '1-tests/fscrypt-common}}', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-client'] Failure: Command failed (workunit test fs/test_python.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 1 jobs: ['7362701'] suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs_python}'] Failure: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 1 jobs: ['7362704'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/quota}'] Failure: Command failed on smithi023 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 1 jobs: ['7362708'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'ranks/3', 'session_timeout}', 'tasks/dbench', 'validater/lockdep}'] Failure: Config file not found: "/home/teuthworker/src/git.ceph.com_ceph-c_e318c19728255ff705e0d6553aab0c6a87b22d64/qa/tasks/cephadm.conf". 1 jobs: ['7362568'] suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/fs/misc}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/3', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/yes}'] Failure: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 1 jobs: ['7362737'] suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/no', '4-flush/no', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/3', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}'] Failure: Test failure: test_subvolume_snapshot_clone_on_existing_subvolumes (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 1 jobs: ['7362709'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}'] Valgrind: mon (InvalidRead, Leak_PossiblyLost, Leak_StillReachable) 1 jobs: ['7362631'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}'] Failure: "2023-08-08T14:03:24.378493+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 138116.428005 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log 1 jobs: ['7362676'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/mds-full}']