2023-08-08T11:25:24.746 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T11:25:24.748 INFO:teuthology.results:subset: '273/1024' 2023-08-08T11:25:24.748 INFO:teuthology.results:seed: '3759' 2023-08-08T22:35:11.382 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T22:35:11.412 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-09T10:35:13.260 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-08-09T10:35:30.301 INFO:scrape:Found 197 jobs 2023-08-09T10:35:32.477 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] 2023-08-09T10:35:32.478 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start 2023-08-09T10:35:32.479 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 2023-08-09T10:35:32.479 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start 2023-08-09T10:35:32.480 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.480 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 2023-08-09T10:35:32.481 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-09T10:35:32.481 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.482 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.482 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.482 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.483 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.484 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-09T10:35:32.484 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.485 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.485 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.486 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.486 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.487 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.487 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-09T10:35:32.487 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.488 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-09T10:35:32.488 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.489 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.489 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.490 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.490 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.491 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-09T10:35:32.491 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.492 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-09T10:35:32.492 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.493 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.493 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.493 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.494 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.494 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.495 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-09T10:35:32.495 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.496 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.496 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.497 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-09T10:35:32.497 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.498 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-09T10:35:32.498 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.499 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.499 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-09T10:35:32.499 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.500 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.501 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.501 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.502 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.502 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.503 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.503 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.504 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.504 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.505 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.505 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-09T10:35:32.506 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.506 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.507 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-09T10:35:32.507 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.508 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-09T10:35:32.508 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.508 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.509 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.509 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-09T10:35:32.510 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.510 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.511 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.511 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.511 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.512 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.512 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.513 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.513 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.514 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-09T10:35:32.514 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.515 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.515 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.515 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.516 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.517 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.518 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.518 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-09T10:35:32.519 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.519 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-09T10:35:32.520 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-09T10:35:32.520 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.521 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.521 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.521 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.522 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.522 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.523 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.523 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.524 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.524 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.524 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.525 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.525 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.526 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.526 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.527 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.527 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.527 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.528 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.528 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.529 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.529 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-09T10:35:32.530 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.530 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.530 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.531 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.531 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.532 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-09T10:35:32.532 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.533 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, 2023-08-09T10:35:32.533 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-09T10:35:32.533 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, 2023-08-09T10:35:32.534 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.534 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-09T10:35:32.535 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-08-09T10:35:32.535 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2023-08-09T10:35:32.538 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 2023-08-09T10:35:32.539 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 2023-08-09T10:35:32.540 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start 2023-08-09T10:35:32.540 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 2023-08-09T10:35:32.541 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections 2023-08-09T10:35:32.541 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 2023-08-09T10:35:32.542 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.542 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T10:35:32.543 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-09T10:35:32.544 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-09T10:35:32.544 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections 2023-08-09T10:35:32.545 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 2023-08-09T10:35:32.545 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.546 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 2023-08-09T10:35:32.546 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 2023-08-09T10:35:32.547 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.548 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections 2023-08-09T10:35:32.550 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.550 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.552 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 2023-08-09T10:35:32.553 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.554 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.554 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.555 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.555 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.556 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.556 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections 2023-08-09T10:35:32.557 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz 2023-08-09T10:35:32.557 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T10:35:32.558 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2023-08-09T10:35:32.558 WARNING:scrape:Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s 2023-08-09T10:35:32.590 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] 2023-08-09T10:35:32.591 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start 2023-08-09T10:35:32.592 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 2023-08-09T10:35:32.593 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start 2023-08-09T10:35:32.593 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.594 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 2023-08-09T10:35:32.594 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-09T10:35:32.595 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.595 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.595 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.596 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.596 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.597 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-09T10:35:32.597 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.598 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.598 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.599 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.599 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.599 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.600 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-09T10:35:32.600 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.601 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-09T10:35:32.601 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.602 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.602 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.603 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.603 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.603 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-09T10:35:32.604 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.604 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-09T10:35:32.605 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.605 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.606 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.606 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.607 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.607 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.608 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-09T10:35:32.608 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.609 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.609 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.609 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-09T10:35:32.610 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.610 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-09T10:35:32.611 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.611 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.612 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-09T10:35:32.612 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.613 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.613 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.614 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.614 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.614 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.615 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.615 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.616 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.616 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.617 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.617 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-09T10:35:32.618 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.618 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.618 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-09T10:35:32.619 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.619 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-09T10:35:32.620 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.620 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.621 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.621 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-09T10:35:32.622 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.622 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.623 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.623 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.623 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.624 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.624 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.625 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.625 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.626 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-09T10:35:32.626 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.626 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.627 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.627 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.628 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.628 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.629 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.629 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-09T10:35:32.630 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.630 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-09T10:35:32.630 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-09T10:35:32.631 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.631 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.632 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.632 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.633 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.633 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.633 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.634 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.634 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.635 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.635 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.635 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.636 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.636 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.637 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.637 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.638 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.638 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.638 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.639 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.639 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.640 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-09T10:35:32.640 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.641 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.641 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.641 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.642 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.642 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-09T10:35:32.643 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.643 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, 2023-08-09T10:35:32.643 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-09T10:35:32.644 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, 2023-08-09T10:35:32.644 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.645 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-09T10:35:32.645 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-08-09T10:35:32.646 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2023-08-09T10:35:32.648 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 2023-08-09T10:35:32.649 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 2023-08-09T10:35:32.650 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start 2023-08-09T10:35:32.651 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 2023-08-09T10:35:32.651 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections 2023-08-09T10:35:32.652 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 2023-08-09T10:35:32.652 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.653 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T10:35:32.653 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-09T10:35:32.654 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-09T10:35:32.654 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections 2023-08-09T10:35:32.655 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 2023-08-09T10:35:32.655 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.656 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 2023-08-09T10:35:32.656 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 2023-08-09T10:35:32.657 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.658 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections 2023-08-09T10:35:32.660 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.660 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.662 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 2023-08-09T10:35:32.663 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.664 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.664 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.665 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.665 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.666 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.666 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections 2023-08-09T10:35:32.667 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz 2023-08-09T10:35:32.667 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T10:35:32.668 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2023-08-09T10:35:32.668 WARNING:scrape:Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s 2023-08-09T10:35:32.702 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] 2023-08-09T10:35:32.703 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start 2023-08-09T10:35:32.704 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 2023-08-09T10:35:32.704 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start 2023-08-09T10:35:32.705 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.705 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 2023-08-09T10:35:32.706 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-09T10:35:32.706 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.707 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.707 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.708 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.708 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.709 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-09T10:35:32.709 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.710 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.710 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.711 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.712 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.712 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.713 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-09T10:35:32.713 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.714 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-09T10:35:32.714 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.714 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.715 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.716 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.717 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.717 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-09T10:35:32.717 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.718 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-09T10:35:32.718 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.719 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.719 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.720 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.720 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.721 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.722 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-09T10:35:32.722 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.723 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.723 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.724 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-09T10:35:32.725 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.725 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-09T10:35:32.726 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.726 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.727 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-09T10:35:32.727 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.728 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.728 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.729 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.729 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.730 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.730 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.731 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.731 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.732 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.732 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.733 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-09T10:35:32.733 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.734 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.734 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-09T10:35:32.734 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.735 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-09T10:35:32.735 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.736 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.736 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.737 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-09T10:35:32.737 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.738 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.739 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.739 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.740 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.740 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.741 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.741 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.741 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.742 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-09T10:35:32.742 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.743 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.743 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.744 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.745 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.746 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.747 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.748 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-09T10:35:32.748 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.749 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-09T10:35:32.750 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-09T10:35:32.751 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.752 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.753 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.754 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.754 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.755 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.756 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.757 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.758 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.759 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.760 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.761 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.762 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.763 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.764 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.764 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.765 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.765 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.766 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.766 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.767 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.767 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-09T10:35:32.768 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.768 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.769 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.769 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.770 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.770 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-09T10:35:32.771 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.771 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, 2023-08-09T10:35:32.772 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-09T10:35:32.773 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, 2023-08-09T10:35:32.774 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.774 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-09T10:35:32.775 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-08-09T10:35:32.776 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2023-08-09T10:35:32.778 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 2023-08-09T10:35:32.781 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 2023-08-09T10:35:32.781 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start 2023-08-09T10:35:32.782 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 2023-08-09T10:35:32.782 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections 2023-08-09T10:35:32.783 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 2023-08-09T10:35:32.783 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.784 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T10:35:32.785 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-09T10:35:32.785 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-09T10:35:32.786 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections 2023-08-09T10:35:32.786 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 2023-08-09T10:35:32.787 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.788 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 2023-08-09T10:35:32.788 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 2023-08-09T10:35:32.789 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.790 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections 2023-08-09T10:35:32.792 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.793 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.795 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 2023-08-09T10:35:32.798 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.799 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.800 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.801 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.802 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.803 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.804 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections 2023-08-09T10:35:32.805 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz 2023-08-09T10:35:32.805 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T10:35:32.806 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2023-08-09T10:35:32.807 WARNING:scrape:Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s 2023-08-09T10:35:32.844 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] 2023-08-09T10:35:32.846 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start 2023-08-09T10:35:32.846 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 2023-08-09T10:35:32.847 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start 2023-08-09T10:35:32.848 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.848 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 2023-08-09T10:35:32.849 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-09T10:35:32.849 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.850 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.850 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.851 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.851 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.851 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-09T10:35:32.852 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.852 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.853 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.854 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.854 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.855 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.855 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-09T10:35:32.855 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.856 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-09T10:35:32.856 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.857 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.857 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.858 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.858 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.859 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-09T10:35:32.859 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.859 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-09T10:35:32.860 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.860 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.861 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.861 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.862 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.862 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.863 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-09T10:35:32.863 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.864 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.864 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.864 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-09T10:35:32.865 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.865 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-09T10:35:32.866 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.866 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.867 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-09T10:35:32.867 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.868 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.868 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.868 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.869 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.869 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.870 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.870 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.871 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.871 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.872 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.872 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-09T10:35:32.873 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.873 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.873 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-09T10:35:32.874 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.874 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-09T10:35:32.875 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.875 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.876 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.876 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-09T10:35:32.877 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.877 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.878 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.878 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.879 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.879 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.879 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.880 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.880 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.881 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-09T10:35:32.881 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.882 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.882 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.882 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.883 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.883 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.884 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.884 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-09T10:35:32.885 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.885 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-09T10:35:32.886 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-09T10:35:32.886 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.886 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:32.887 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.887 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.888 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.888 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.889 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.889 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.889 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.890 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.890 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.891 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.891 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.892 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.892 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.893 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.893 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.893 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:32.894 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:32.894 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.895 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.895 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-09T10:35:32.896 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:32.896 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.896 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.897 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.897 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.898 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-09T10:35:32.898 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.899 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, 2023-08-09T10:35:32.899 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-09T10:35:32.899 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, 2023-08-09T10:35:32.900 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.900 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-09T10:35:32.901 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-08-09T10:35:32.901 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2023-08-09T10:35:32.904 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 2023-08-09T10:35:32.905 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 2023-08-09T10:35:32.906 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start 2023-08-09T10:35:32.906 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 2023-08-09T10:35:32.907 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections 2023-08-09T10:35:32.907 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 2023-08-09T10:35:32.908 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.908 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T10:35:32.909 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-09T10:35:32.909 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-09T10:35:32.910 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections 2023-08-09T10:35:32.911 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 2023-08-09T10:35:32.911 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.912 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 2023-08-09T10:35:32.913 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 2023-08-09T10:35:32.914 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.917 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections 2023-08-09T10:35:32.919 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.921 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:32.923 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 2023-08-09T10:35:32.925 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:32.927 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.928 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:32.929 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.930 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.931 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:32.932 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections 2023-08-09T10:35:32.933 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz 2023-08-09T10:35:32.934 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T10:35:32.934 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2023-08-09T10:35:32.935 WARNING:scrape:Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s 2023-08-09T10:35:32.974 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] 2023-08-09T10:35:32.977 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start 2023-08-09T10:35:32.978 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 2023-08-09T10:35:32.979 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start 2023-08-09T10:35:32.980 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:32.981 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 2023-08-09T10:35:32.982 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-09T10:35:32.982 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.983 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.983 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.983 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.984 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:32.984 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-09T10:35:32.985 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:32.985 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:32.986 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.986 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.987 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:32.987 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:32.988 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-09T10:35:32.988 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.989 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-09T10:35:32.989 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:32.989 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.990 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.990 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.991 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.991 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-09T10:35:32.992 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.992 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-09T10:35:32.992 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.993 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.993 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:32.994 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:32.994 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:32.995 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:32.995 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-09T10:35:32.996 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.996 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:32.996 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:32.997 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-09T10:35:32.997 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:32.998 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-09T10:35:32.998 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:32.999 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:32.999 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-09T10:35:32.999 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.000 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.000 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.001 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.001 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.002 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.002 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.003 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.003 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.003 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.004 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.004 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-09T10:35:33.005 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.005 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.006 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-09T10:35:33.006 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.006 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-09T10:35:33.007 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.007 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.008 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.008 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-09T10:35:33.009 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.009 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.009 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.010 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.010 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.011 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:33.011 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:33.012 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.012 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.012 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-09T10:35:33.013 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.013 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.014 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.014 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.015 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:33.015 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.015 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.016 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-09T10:35:33.016 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.017 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-09T10:35:33.017 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-09T10:35:33.018 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.018 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:33.018 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.019 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:33.019 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:33.020 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.020 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:33.021 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:33.021 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.021 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.022 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.022 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.023 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.023 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.024 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.024 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.024 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.025 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:33.025 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:33.026 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:33.026 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.027 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-09T10:35:33.027 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:33.027 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.028 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:33.028 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.029 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.029 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-09T10:35:33.029 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.030 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, 2023-08-09T10:35:33.030 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-09T10:35:33.031 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, 2023-08-09T10:35:33.031 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.032 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-09T10:35:33.032 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-08-09T10:35:33.033 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2023-08-09T10:35:33.035 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 2023-08-09T10:35:33.036 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 2023-08-09T10:35:33.037 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start 2023-08-09T10:35:33.037 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 2023-08-09T10:35:33.038 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections 2023-08-09T10:35:33.038 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 2023-08-09T10:35:33.039 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:33.039 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T10:35:33.040 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-09T10:35:33.040 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-09T10:35:33.041 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections 2023-08-09T10:35:33.042 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 2023-08-09T10:35:33.042 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:33.043 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 2023-08-09T10:35:33.043 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 2023-08-09T10:35:33.044 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:33.045 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections 2023-08-09T10:35:33.046 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:33.047 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:33.048 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 2023-08-09T10:35:33.050 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:33.050 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.051 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:33.051 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.052 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.052 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.053 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections 2023-08-09T10:35:33.053 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz 2023-08-09T10:35:33.054 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T10:35:33.054 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2023-08-09T10:35:33.055 WARNING:scrape:Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s 2023-08-09T10:35:33.085 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-5396-ge318c197 (e318c19728255ff705e0d6553aab0c6a87b22d64) reef (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f81f03234af] , 2: /usr/lib/ceph/libceph-common.so.2(+0x32366b) [0x7f81f032366b] 2023-08-09T10:35:33.086 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- 172.21.15.107:0/2957121679 wait complete. , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 Processor -- start , 2023-08-08T13:38:36.877+0000 7f20e305a700 1 -- start start 2023-08-09T10:35:33.086 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.269+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8145340 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56cf4eb700 1 -- 172.21.15.107:0/985007899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8067c00 con 0x7f56c80b8630 , 2023-08-08T13:38:37.273+0000 7f56beffd700 1 -- 172.21.15.107:0/985007899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f56b800cbb0 con 0x7f56c80b8630 2023-08-09T10:35:33.087 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:37.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 Processor -- start , 2023-08-08T13:38:38.081+0000 7f0ad22f0700 1 -- start start 2023-08-09T10:35:33.087 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 -- start start , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e7c06eaf0 0x7f9e7c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.513+0000 7f9e834f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e7c0b0ee0 0x7f9e7c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:33.088 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:38.929+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff380003a40 con 0x7ff3900aa8c0 , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 --2- 172.21.15.107:0/628025422 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7ff3700656f0 0x7ff370067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:38.933+0000 7ff38d7fa700 1 -- 172.21.15.107:0/628025422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff380020070 con 0x7ff3900aa8c0 2023-08-09T10:35:33.088 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", , 2023-08-08T13:38:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", , 2023-08-08T13:38:39.208 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-09T10:35:33.089 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.089 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.090 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:33.090 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", , 2023-08-08T13:38:39.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.091 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", , 2023-08-08T13:38:39.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:33.091 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.346 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-09T10:35:33.091 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.092 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.092 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.093 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:39.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.093 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", , 2023-08-08T13:38:39.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.094 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.094 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.482 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", , 2023-08-08T13:38:39.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-09T10:35:33.095 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.095 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { , 2023-08-08T13:38:39.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-09T10:35:33.095 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.096 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.096 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.097 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.097 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.098 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-09T10:35:33.098 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.099 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { , 2023-08-08T13:38:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-09T10:35:33.099 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.099 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.100 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.100 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:33.101 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.101 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:33.102 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { , 2023-08-08T13:38:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-09T10:35:33.102 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.102 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:33.103 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.103 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-09T10:35:33.104 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.104 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { , 2023-08-08T13:38:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-09T10:35:33.105 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.105 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", , 2023-08-08T13:38:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.106 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-09T10:35:33.106 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.106 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.107 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: ], , 2023-08-08T13:38:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.107 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.108 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.108 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.109 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.109 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.109 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.110 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.110 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.111 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" , 2023-08-08T13:38:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-09T10:35:33.111 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.112 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.112 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { , 2023-08-08T13:38:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-09T10:35:33.112 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.113 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", , 2023-08-08T13:38:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { , 2023-08-08T13:38:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-09T10:35:33.113 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", , 2023-08-08T13:38:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.114 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", , 2023-08-08T13:38:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.114 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.115 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { , 2023-08-08T13:38:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-09T10:35:33.115 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.115 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.116 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", , 2023-08-08T13:38:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.116 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.117 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.117 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", , 2023-08-08T13:38:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-09T10:35:33.118 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:33.118 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.118 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.119 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-09T10:35:33.119 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", , 2023-08-08T13:38:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-09T10:35:33.120 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.120 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.121 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.121 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:33.122 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-09T10:35:33.122 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-09T10:35:33.122 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-09T10:35:33.123 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.123 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", , 2023-08-08T13:38:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-09T10:35:33.124 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-09T10:35:33.124 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.124 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { , 2023-08-08T13:38:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-09T10:35:33.125 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.125 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:33.126 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:33.126 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.127 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-09T10:35:33.127 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:33.127 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", , 2023-08-08T13:38:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.128 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", , 2023-08-08T13:38:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-09T10:35:33.128 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.129 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", , 2023-08-08T13:38:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.129 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, , 2023-08-08T13:38:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", , 2023-08-08T13:38:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-09T10:35:33.130 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.130 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-09T10:35:33.130 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-09T10:35:33.131 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.131 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-09T10:35:33.132 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ , 2023-08-08T13:38:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "", , 2023-08-08T13:38:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-09T10:35:33.132 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-09T10:35:33.133 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-09T10:35:33.133 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, , 2023-08-08T13:38:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-09T10:35:33.133 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", , 2023-08-08T13:38:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-09T10:35:33.134 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", , 2023-08-08T13:38:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-09T10:35:33.134 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", , 2023-08-08T13:38:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-09T10:35:33.135 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", , 2023-08-08T13:38:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-09T10:35:33.135 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] , 2023-08-08T13:38:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.135 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: { , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", , 2023-08-08T13:38:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-09T10:35:33.136 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001220952, , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000374 , 2023-08-08T13:38:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.136 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 40635, , 2023-08-08T13:38:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 29586, 2023-08-09T10:35:33.137 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002003173 , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-09T10:35:33.138 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, , 2023-08-08T13:38:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { , 2023-08-08T13:38:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 120, 2023-08-09T10:35:33.138 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 , 2023-08-08T13:38:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-09T10:35:33.139 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 111414, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, , 2023-08-08T13:38:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-09T10:35:33.139 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 , 2023-08-08T13:38:41.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-08-09T10:35:33.140 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 27, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, , 2023-08-08T13:38:42.025 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2023-08-09T10:35:33.142 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:42.233+0000 7fd23ffff700 1 --2- 172.21.15.107:0/2240042930 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fd2280656f0 0x7fd228067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd230001200 tx=0x7fd230001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 , 2023-08-08T13:38:42.237+0000 7fd244ff9700 1 -- 172.21.15.107:0/2240042930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7fd238052160 con 0x7fd2480b2420 , 2023-08-08T13:38:42.405+0000 7fd24d837700 1 -- 172.21.15.107:0/2240042930 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2480b0d60 con 0x7fd2280656f0 2023-08-09T10:35:33.144 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- start start , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e880afa00 0x7f1e88144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:43.133+0000 7f1e8f420700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880ae9c0 con 0x7f1e88144d50 2023-08-09T10:35:33.144 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 shutdown_connections , 2023-08-08T13:38:43.589+0000 7f5b6aad8700 1 -- 172.21.15.107:0/3065621803 wait complete. , 2023-08-08T13:38:43.593+0000 7f5b6aad8700 1 Processor -- start 2023-08-09T10:35:33.145 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00036c0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2c2b7f700 1 -- 172.21.15.107:0/1023092207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1de8f0 con 0x7ff2bc0b4640 , 2023-08-08T13:38:45.093+0000 7ff2b97fa700 1 -- 172.21.15.107:0/1023092207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003a50 con 0x7ff2bc0b4640 2023-08-09T10:35:33.146 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 --2- 172.21.15.107:0/3436733398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded40b2420 0x7fded41ded80 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 >> 172.21.15.107:0/3436733398 conn(0x7fded40b7830 msgr2=0x7fded40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:45.513+0000 7fdeda5d9700 1 -- 172.21.15.107:0/3436733398 shutdown_connections 2023-08-09T10:35:33.146 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894535374 0 0) 0x7f9d400ae9c0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035d0 con 0x7f9d400aa8c0 , 2023-08-08T13:38:45.957+0000 7f9d377fe700 1 -- 172.21.15.107:0/2879102846 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014859501 0 0) 0x7f9d280035d0 con 0x7f9d400aa8c0 2023-08-09T10:35:33.147 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 -- start start , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5500b3070 0x7fb550143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-08-08T13:38:46.365+0000 7fb554dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5500b8810 0x7fb5501df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T10:35:33.147 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94380b10b0 0x7f94381df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 -- 172.21.15.107:0/3219038287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9438144940 , 2023-08-08T13:38:46.605+0000 7f9436d9d700 1 --2- 172.21.15.107:0/3219038287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9438144940 0x7f943813cd90 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f943806c6c0 tx=0x7f9430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T10:35:33.148 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.021+0000 7eff3a7fc700 1 -- 172.21.15.107:0/4293313397 <== osd.3 v2:172.21.15.107:6801/3589913549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff3c009b90 con 0x7eff2806e050 , 2023-08-08T13:38:47.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ , 2023-08-08T13:38:47.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-09T10:35:33.148 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a04071cb0 0x7f0a04072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42088/0 (socket says 172.21.15.107:42088) , 2023-08-08T13:38:47.613+0000 7f0a03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a040a8480 0x7f0a040a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.107:38580/0 (socket says 172.21.15.107:38580) , 2023-08-08T13:38:47.613+0000 7f0a0936f700 1 -- 172.21.15.107:0/1086295290 learned_addr learned my addr 172.21.15.107:0/1086295290 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-09T10:35:33.149 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:47.853+0000 7f45952d8700 1 --2- 172.21.15.107:0/319391904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45900aa8c0 0x7f45900b35c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 >> 172.21.15.107:0/319391904 conn(0x7f45900b75c0 msgr2=0x7f45900b79d0 unknown :-1 s=STATE_NONE l=0).mark_down , 2023-08-08T13:38:47.853+0000 7f45952d8700 1 -- 172.21.15.107:0/319391904 shutdown_connections 2023-08-09T10:35:33.149 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ab50 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f693effd700 1 -- 172.21.15.107:0/1301435157 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000acb0 con 0x7f6948146850 , 2023-08-08T13:38:48.261+0000 7f695051a700 1 -- 172.21.15.107:0/1301435157 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948143590 con 0x7f6948146850 2023-08-09T10:35:33.150 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec0014a020 0x7fec00143e70 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec001403c0 0x7fec000b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:38:48.685+0000 7fec05474700 1 --2- 172.21.15.107:0/1680663979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec0006b030 0x7fec00146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:33.150 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116717809 0 0) 0x7f97e40b13e0 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4144490 con 0x7f97e40b4190 , 2023-08-08T13:38:49.137+0000 7f97e37fe700 1 -- 172.21.15.107:0/2174693675 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50472635 0 0) 0x7f97cc0035d0 con 0x7f97e4071dc0 2023-08-09T10:35:33.151 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbf40b3070 , 2023-08-08T13:38:49.549+0000 7fcbf37fe700 1 -- 172.21.15.107:0/3134449308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d40 con 0x7fcbf40b3070 2023-08-09T10:35:33.151 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:49.801+0000 7f220ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22101cf6e0 0x7f22101cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42210/0 (socket says 172.21.15.107:42210) , 2023-08-08T13:38:49.801+0000 7f220ffff700 1 -- 172.21.15.107:0/534391698 learned_addr learned my addr 172.21.15.107:0/534391698 (peer_addr_for_me v2:172.21.15.107:0/0) , 2023-08-08T13:38:49.805+0000 7f220effd700 1 --2- 172.21.15.107:0/534391698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f221006cc80 0x7f22101d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:33.153 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 msgr2=0x7f98401db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:38:50.401+0000 7f984692b700 1 --2- 172.21.15.107:0/2878559627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f984014a450 0x7f98401db870 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f98400b9040 tx=0x7f9838004af0 comp rx=0 tx=0).stop , 2023-08-08T13:38:50.401+0000 7f984692b700 1 -- 172.21.15.107:0/2878559627 shutdown_connections 2023-08-09T10:35:33.154 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-08T13:34:15.683013+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=15, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:38:50.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:33.155 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) , 2023-08-08T13:39:10.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-08T13:34:16.693207+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=34, tm_sec=16, tm_wday=1, tm_yday=220, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=8, tm_hour=13, tm_min=38, tm_sec=43, tm_wday=1, tm_yday=220, tm_isdst=0) 2023-08-09T10:35:33.156 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:31.124+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170890 (secure 0 0 0) 0x7f62cc147ac0 con 0x7f62cc0b21b0 , 2023-08-08T13:39:31.292+0000 7f62d4237700 1 -- 172.21.15.107:0/138868038 --> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc14ad80 con 0x7f62b0065720 , 2023-08-08T13:39:31.312+0000 7f62c27fc700 1 -- 172.21.15.107:0/138868038 <== mgr.4100 v2:172.21.15.150:6832/195895445 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313425 (secure 0 0 0) 0x7f62c801f070 con 0x7f62b0065720 2023-08-09T10:35:33.158 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:51.763+0000 7f147359e700 1 -- 172.21.15.107:0/3083140800 shutdown_connections , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7f14540656f0 0x7f1454067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:51.763+0000 7f147359e700 1 --2- 172.21.15.107:0/3083140800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1474149c70 0x7f14741cffe0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T10:35:33.158 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 msgr2=0x7fbb94143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 --2- 172.21.15.107:0/3845998856 >> v2:172.21.15.150:3300/0 conn(0x7fbb9406fd00 0x7fbb94143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:52.415+0000 7fbb99668700 1 -- 172.21.15.107:0/3845998856 >> v1:172.21.15.107:6789/0 conn(0x7fbb940b3200 legacy=0x7fbb940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.159 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ad450 con 0x7f33080afa00 , 2023-08-08T13:39:52.847+0000 7f330d941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081d8ea0 con 0x7f33080aa8c0 , 2023-08-08T13:39:52.847+0000 7f33077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3308144d50 0x7f33081d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T10:35:33.160 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 msgr2=0x7fa4c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 --2- 172.21.15.107:0/1899929864 >> [v2:172.21.15.150:6832/195895445,v1:172.21.15.150:6833/195895445] conn(0x7fa4c00656f0 0x7fa4c0067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ab690 tx=0x7fa4c4009040 comp rx=0 tx=0).stop , 2023-08-08T13:39:53.599+0000 7fa4d9d5d700 1 -- 172.21.15.107:0/1899929864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4d4144e80 msgr2=0x7fa4d41d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.160 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 msgr2=0x7fc19413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 --2- 172.21.15.107:0/3309103853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1940b13c0 0x7fc19413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop , 2023-08-08T13:39:54.235+0000 7fc193fff700 1 -- 172.21.15.107:0/3309103853 >> v1:172.21.15.107:6789/0 conn(0x7fc1940b1800 legacy=0x7fc1941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.161 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:55.259+0000 7f8f4ed9d700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5013fa10 0x7f8f501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4dd9b700 1 --2- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 0x7f8f501de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 , 2023-08-08T13:39:55.259+0000 7f8f4e59c700 1 -- 172.21.15.107:0/2338968084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f500b8810 msgr2=0x7f8f501de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T10:35:33.162 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:39:57.067+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 msgr2=0x7f345413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down , 2023-08-08T13:39:57.067+0000 7f3458fef700 1 --2- 172.21.15.107:0/2598781635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34540b2240 0x7f345413fe40 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f34480090b0 tx=0x7f3448004770 comp rx=0 tx=0).stop , 2023-08-08T13:39:57.071+0000 7f3458fef700 1 -- 172.21.15.107:0/2598781635 shutdown_connections 2023-08-09T10:35:33.162 WARNING:scrape:Ignoring malparsed backtrace: 2023-08-08T13:40:26.738 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.kSLHFLZoc3 is 454KB , 2023-08-08T13:40:26.812 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.kSLHFLZoc3 , 2023-08-08T13:40:26.831 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/data/mon.c.tgz 2023-08-09T10:35:33.163 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log , 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz , /var/log/ceph/ceph-osd.6.log: gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T10:35:33.163 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.41889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz , gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log , /var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2023-08-09T10:35:33.164 WARNING:scrape:Ignoring malparsed backtrace: real 0m2.064s , user 0m5.625s , sys 0m0.663s 2023-08-09T10:35:33.180 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362573/teuthology.log 2023-08-09T10:35:55.447 WARNING:scrape:Misunderstood line: 2023-08-09T10:36:00.013 INFO:scrape:Found 21 distinct failure reasons 2023-08-09T10:36:00.014 INFO:scrape:Failure: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-09T10:36:00.015 INFO:scrape:1 jobs: ['7362592'] 2023-08-09T10:36:00.015 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] 2023-08-09T10:36:00.015 INFO:scrape: 2023-08-09T10:36:00.015 INFO:scrape:Failure: Command failed (workunit test suites/iozone.sh) on smithi079 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/iozone.sh' 2023-08-09T10:36:00.016 INFO:scrape:1 jobs: ['7362637'] 2023-08-09T10:36:00.016 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/iozone}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/thrash/multifs/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2023-08-09T10:36:00.016 INFO:scrape: 2023-08-09T10:36:00.017 INFO:scrape:Failure: Command failed on smithi142 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-08-09T10:36:00.017 INFO:scrape:5 jobs: ['7362684', '7362713', '7362619', '7362587', '7362745'] 2023-08-09T10:36:00.017 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{ignorelist_health'] 2023-08-09T10:36:00.018 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'clusters/1-node-1-mds-1-osd', 'conf/{client', 'distro/{rhel_8}', 'distros/ubuntu_latest', 'fs/full/{begin/{0-install', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides', 'overrides/{ignorelist_health', 'tasks/ior-shared-file}', 'tasks/mdtest}', 'tasks/mgr-osd-full}'] 2023-08-09T10:36:00.018 INFO:scrape: 2023-08-09T10:36:00.018 INFO:scrape:Dead: b'2023-08-09T02:24:27.298 DEBUG:teuthology.exit:Finished running handlers' 2023-08-09T10:36:00.019 INFO:scrape:5 jobs: ['7362714', '7362759', '7362585', '7362653', '7362588'] 2023-08-09T10:36:00.019 INFO:scrape:suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}'] 2023-08-09T10:36:00.019 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_20.04}', 'distro/{ubuntu_latest}', 'frag', 'fs/functional/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'n/3', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'ranks/multi/{export-check', 'replication/always}', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/multifs-auth}', 'tasks/xfstests-dev}', 'tasks/{0-subvolume/{with-quota}', 'wsync/yes}'] 2023-08-09T10:36:00.020 INFO:scrape: 2023-08-09T10:36:00.020 INFO:scrape:Failure: Command failed (workunit test libcephfs/test.sh) on smithi107 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-08-09T10:36:00.020 INFO:scrape:1 jobs: ['7362651'] 2023-08-09T10:36:00.021 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs/{frag', 'test}}'] 2023-08-09T10:36:00.021 INFO:scrape: 2023-08-09T10:36:00.021 INFO:scrape:Dead: None 2023-08-09T10:36:00.022 INFO:scrape:6 jobs: ['7362573', '7362699', '7362645', '7362758', '7362625', '7362597'] 2023-08-09T10:36:00.022 INFO:scrape: 2023-08-09T10:36:00.022 INFO:scrape:Failure: Command failed (workunit test suites/dbench.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2023-08-09T10:36:00.023 INFO:scrape:1 jobs: ['7362608'] 2023-08-09T10:36:00.023 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}', 'wsync/yes}'] 2023-08-09T10:36:00.023 INFO:scrape: 2023-08-09T10:36:00.024 INFO:scrape:Failure: Command failed (workunit test fs/quota/quota.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh' 2023-08-09T10:36:00.024 INFO:scrape:2 jobs: ['7362596', '7362764'] 2023-08-09T10:36:00.024 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] 2023-08-09T10:36:00.024 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] 2023-08-09T10:36:00.025 INFO:scrape: 2023-08-09T10:36:00.025 INFO:scrape:Failure: Command failed on smithi181 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib' 2023-08-09T10:36:00.025 INFO:scrape:2 jobs: ['7362584', '7362583'] 2023-08-09T10:36:00.026 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'osd}'] 2023-08-09T10:36:00.026 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', '2-workunit/fs/trivial_sync}}', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'no_client_pidfile}', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag', 'overrides/{ignorelist_health', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'races', 'ranks/5', 'session_timeout', 'tasks/truncate_delay}', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2023-08-09T10:36:00.026 INFO:scrape: 2023-08-09T10:36:00.027 INFO:scrape:Failure: Command failed (workunit test kernel_untar_build.sh) on smithi175 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2023-08-09T10:36:00.027 INFO:scrape:3 jobs: ['7362681', '7362730', '7362572'] 2023-08-09T10:36:00.027 INFO:scrape:suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}'] 2023-08-09T10:36:00.027 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/kernel_untar_build}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'frag', 'fs/mixed-clients/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd-asserts}', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/1', 'session_timeout}', 'standby-replay', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/{0-subvolume/{with-namespace-isolated}', 'wsync/yes}'] 2023-08-09T10:36:00.028 INFO:scrape: 2023-08-09T10:36:00.028 INFO:scrape:Failure: No module named 'tasks.ceph' 2023-08-09T10:36:00.028 INFO:scrape:7 jobs: ['7362582', '7362578', '7362579', '7362569', '7362581', '7362604', '7362603'] 2023-08-09T10:36:00.029 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}'] 2023-08-09T10:36:00.029 INFO:scrape:suites union: ['1-ceph', '1-client-sanity}}}', '1-mount/mount/fuse', '2-logrotate}', '2-workload/new_ops/{0-clients/fuse-upgrade', '2-workunit/suites/fsstress}}', 'centos_8', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'clusters/{1-mds-1-client-micro}', 'conf/{client', 'distro/{centos_8}', 'distro/{centos_latest}', 'distro/{rhel_8}', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'fs/permission/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/upgrade/upgraded_client/{bluestore-bitmap', 'fs/volumes/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'overrides/{ignorelist_health', 'pg-warn}', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/3', 'rhel_8}', 'session_timeout', 'tasks/admin}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/test_journal_migration}', 'tasks/volumes/{overrides', 'tasks/{0-from/nautilus', 'tasks/{1-thrash/osd', 'test/clone}}', 'thrashosds-health}'] 2023-08-09T10:36:00.029 INFO:scrape: 2023-08-09T10:36:00.030 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2023-08-09T10:36:00.030 INFO:scrape:1 jobs: ['7362755'] 2023-08-09T10:36:00.030 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] 2023-08-09T10:36:00.031 INFO:scrape: 2023-08-09T10:36:00.031 INFO:scrape:Failure: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-08-09T10:36:00.031 INFO:scrape:1 jobs: ['7362683'] 2023-08-09T10:36:00.031 INFO:scrape:suites: ['1-ceph', '1-tests/fscrypt-common}}', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-client'] 2023-08-09T10:36:00.032 INFO:scrape: 2023-08-09T10:36:00.032 INFO:scrape:Failure: Command failed (workunit test fs/test_python.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 2023-08-09T10:36:00.032 INFO:scrape:1 jobs: ['7362701'] 2023-08-09T10:36:00.033 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs_python}'] 2023-08-09T10:36:00.033 INFO:scrape: 2023-08-09T10:36:00.033 INFO:scrape:Failure: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-09T10:36:00.033 INFO:scrape:1 jobs: ['7362704'] 2023-08-09T10:36:00.034 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/quota}'] 2023-08-09T10:36:00.034 INFO:scrape: 2023-08-09T10:36:00.034 INFO:scrape:Failure: Command failed on smithi023 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2023-08-09T10:36:00.035 INFO:scrape:1 jobs: ['7362708'] 2023-08-09T10:36:00.035 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'ranks/3', 'session_timeout}', 'tasks/dbench', 'validater/lockdep}'] 2023-08-09T10:36:00.035 INFO:scrape: 2023-08-09T10:36:00.036 INFO:scrape:Failure: Config file not found: "/home/teuthworker/src/git.ceph.com_ceph-c_e318c19728255ff705e0d6553aab0c6a87b22d64/qa/tasks/cephadm.conf". 2023-08-09T10:36:00.036 INFO:scrape:1 jobs: ['7362568'] 2023-08-09T10:36:00.036 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/fs/misc}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/3', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/yes}'] 2023-08-09T10:36:00.036 INFO:scrape: 2023-08-09T10:36:00.037 INFO:scrape:Failure: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-08-09T10:36:00.037 INFO:scrape:1 jobs: ['7362737'] 2023-08-09T10:36:00.037 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/no', '4-flush/no', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/3', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}'] 2023-08-09T10:36:00.038 INFO:scrape: 2023-08-09T10:36:00.038 INFO:scrape:Failure: Test failure: test_subvolume_snapshot_clone_on_existing_subvolumes (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-08-09T10:36:00.038 INFO:scrape:1 jobs: ['7362709'] 2023-08-09T10:36:00.038 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}'] 2023-08-09T10:36:00.039 INFO:scrape: 2023-08-09T10:36:00.039 INFO:scrape:Valgrind: mon (InvalidRead, Leak_PossiblyLost, Leak_StillReachable) 2023-08-09T10:36:00.039 INFO:scrape:1 jobs: ['7362631'] 2023-08-09T10:36:00.040 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}'] 2023-08-09T10:36:00.040 INFO:scrape: 2023-08-09T10:36:00.040 INFO:scrape:Failure: "2023-08-08T14:03:24.378493+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 138116.428005 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log 2023-08-09T10:36:00.041 INFO:scrape:1 jobs: ['7362676'] 2023-08-09T10:36:00.041 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/mds-full}'] 2023-08-09T10:36:00.041 INFO:scrape: 2023-08-09T10:36:00.051 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/ failed: 33 dead: 10 running: 1 waiting: 0 queued: 0 passed: 153 Fail ================================================================= [7362568] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} ----------------------------------------------------------------- time: 00:22:19 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362568/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362568/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f716500b4cec4bb69e0eeb12b0396ef5 Config file not found: "/home/teuthworker/src/git.ceph.com_ceph- c_e318c19728255ff705e0d6553aab0c6a87b22d64/qa/tasks/cephadm.conf". [7362569] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} ----------------------------------------------------------------- time: 00:19:05 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362569/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362569/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69c607b7f36d451aa416a42643d4740f No module named 'tasks.cephfs_test_runner' [7362572] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:24:54 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362572/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362572/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38ec7cd5d16244249658c08a1b1edb15 Command failed (workunit test kernel_untar_build.sh) on smithi107 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' [7362578] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} ----------------------------------------------------------------- time: 00:15:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362578/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362578/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05dbede1868a46cb81d1e16c3efcbd9a No module named 'tasks.cephfs.fuse_mount' [7362579] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 00:14:58 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362579/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362579/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aadf8ecff1de437e90c165e14b9974a2 No module named 'tasks.ceph' [7362581] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:13:16 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362581/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362581/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d0e3096e9eb4497bfdcf5e4b6d86c4b No module named 'tasks.cephfs.fuse_mount' [7362582] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} ----------------------------------------------------------------- time: 00:18:10 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362582/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362582/ sentry: https://sentry.ceph.com/organizations/ceph/?query=092db38ee34a4c7fad3a83467844cb9f No module named 'tasks.ceph' [7362583] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} ----------------------------------------------------------------- time: 00:12:49 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362583/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362583/ sentry: https://sentry.ceph.com/organizations/ceph/?query=553626f4632a42c5b19780135b43073a Command failed on smithi096 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf- devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio- devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql- server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql- contrib' [7362584] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:11:29 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362584/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362584/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5c4eea3943b4ddfa0ff842ff01bffac Command failed on smithi181 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf- devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio- devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql- server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql- contrib' [7362587] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} ----------------------------------------------------------------- time: 00:16:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362587/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362587/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c885c82c82d44af4970b852a1d77a4ff Command failed on smithi162 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7362592] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} ----------------------------------------------------------------- time: 10:10:29 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362592/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362592/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05a342d565564eaca7ae8eef2f004518 Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) [7362596] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} ----------------------------------------------------------------- time: 00:17:49 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362596/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362596/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7ab8ffb77804361bfcaa72cf6f37b20 Command failed (workunit test fs/quota/quota.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh' [7362603] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:15:06 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362603/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362603/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63c943b2769d48fd8934aee598ec218e No module named 'tasks' [7362604] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} ----------------------------------------------------------------- time: 00:11:15 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362604/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362604/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31de1338f5654784af55baf85f4cd984 No module named 'tasks' [7362608] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} ----------------------------------------------------------------- time: 00:44:29 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362608/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362608/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d019ad740f746c198952391cb12fa25 Command failed (workunit test suites/dbench.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' [7362619] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} ----------------------------------------------------------------- time: 00:17:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362619/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362619/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0864e1d071f46199ddf4fa4f9baa1f5 Command failed on smithi169 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7362631] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:31:59 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362631/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362631/ sentry: https://sentry.ceph.com/organizations/ceph/?query=722145a7ff254ef0821c5e93fd2c14d9 saw valgrind issues [7362637] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} ----------------------------------------------------------------- time: 00:21:17 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362637/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362637/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25bb954b6e6b41b9999ada7ede6efe7f Command failed (workunit test suites/iozone.sh) on smithi079 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/iozone.sh' [7362651] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} ----------------------------------------------------------------- time: 00:19:15 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5df4c45d403c42d2b97b31bba854ce47 Command failed (workunit test libcephfs/test.sh) on smithi107 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' [7362676] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} ----------------------------------------------------------------- time: 00:25:26 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362676/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362676/ "2023-08-08T14:03:24.378493+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 138116.428005 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log [7362681] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:25:36 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362681/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362681/ sentry: https://sentry.ceph.com/organizations/ceph/?query=074927d7a0074eb1816a9cc6fc1f38f8 Command failed (workunit test kernel_untar_build.sh) on smithi175 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' [7362683] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} ----------------------------------------------------------------- time: 00:16:25 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362683/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362683/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce86c63cdc5a4915a3d98d51c4a9b3d5 Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) [7362684] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} ----------------------------------------------------------------- time: 00:15:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362684/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362684/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8a75b011e2944dc89f9bc01d1f0726cd Command failed on smithi142 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7362701] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} ----------------------------------------------------------------- time: 00:16:43 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362701/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=33159214b7e6477dae2964a8edf9e45c Command failed (workunit test fs/test_python.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' [7362704] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} ----------------------------------------------------------------- time: 00:23:54 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362704/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362704/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d684b2a0d524d20b3c840ad4f3ec1ea Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) [7362708] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/lockdep} ----------------------------------------------------------------- time: 00:56:57 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708/ Command failed on smithi023 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' [7362709] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} ----------------------------------------------------------------- time: 00:49:51 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362709/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362709/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5eae75db3eb24809aa13a79d36227614 Test failure: test_subvolume_snapshot_clone_on_existing_subvolumes (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) [7362713] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} ----------------------------------------------------------------- time: 00:16:50 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362713/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362713/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0548dba07164f01a815104d8e1f69ff Command failed on smithi195 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7362730] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/kernel_untar_build}} ----------------------------------------------------------------- time: 00:50:21 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362730/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362730/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c7a3ce6eae64a8f849fa928e8d4f905 Command failed (workunit test kernel_untar_build.sh) on smithi070 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' [7362737] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} ----------------------------------------------------------------- time: 01:18:29 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362737/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362737/ error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds [7362745] fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} ----------------------------------------------------------------- time: 00:27:17 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362745/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362745/ Command failed on smithi031 with status 1: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [7362755] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 01:35:42 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362755/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362755/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fbcdffac1f904cc88709eff3f70b8133 Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) [7362764] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} ----------------------------------------------------------------- time: 00:17:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362764/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362764/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19ccfe577c834321bf658080b7adbae0 Command failed (workunit test fs/quota/quota.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e318c19728255ff705e0d6553aab0c6a87b22d64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh' Dead ================================================================= [7362573] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362573/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362573/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7362585] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/postgres}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362585/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362585/ hit max job timeout [7362588] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362588/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362588/ hit max job timeout [7362597] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362597/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362597/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7362625] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362625/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362625/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7362645] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362645/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362645/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7362653] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362653/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362653/ hit max job timeout [7362699] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362699/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362699/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7362714] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362714/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362714/ hit max job timeout [7362758] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362758/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362758/ Error reimaging machines: Timeout opening channel. Running ================================================================= [7362759] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362759/ Pass ================================================================= [7362570] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:40:17 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362570/ [7362571] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} time: 00:36:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362571/ [7362574] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} time: 00:35:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362574/ [7362575] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 02:34:25 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362575/ [7362576] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} time: 02:00:58 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362576/ [7362577] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:37:57 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362577/ [7362580] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:20:14 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362580/ [7362586] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} time: 00:16:59 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362586/ [7362589] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:53:06 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362589/ [7362590] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} time: 00:27:15 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362590/ [7362591] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:25:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362591/ [7362593] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:35:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362593/ [7362594] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep} time: 00:26:04 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362594/ [7362595] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:21:02 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362595/ [7362598] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:38:05 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362598/ [7362599] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} time: 00:30:47 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362599/ [7362600] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:27:45 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362600/ [7362601] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:18:29 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362601/ [7362602] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb} time: 00:17:01 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362602/ [7362605] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:20:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362605/ [7362606] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-ffsb}} time: 02:03:39 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362606/ [7362607] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} time: 00:17:38 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362607/ [7362609] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} time: 00:24:02 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362609/ [7362610] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:47:36 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362610/ [7362611] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:20:51 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362611/ [7362612] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:39:09 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362612/ [7362613] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:18:39 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362613/ [7362614] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} time: 00:22:19 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362614/ [7362615] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 01:42:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362615/ [7362616] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} time: 01:02:01 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362616/ [7362617] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} time: 00:19:55 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362617/ [7362618] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} time: 01:35:54 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362618/ [7362620] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 01:14:49 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362620/ [7362621] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:47:03 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362621/ [7362622] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:24:44 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362622/ [7362623] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} time: 00:14:56 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362623/ [7362624] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:28:25 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362624/ [7362626] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} time: 00:16:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362626/ [7362627] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} time: 00:41:34 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362627/ [7362628] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:20:28 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362628/ [7362629] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:21:57 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362629/ [7362630] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:39:05 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362630/ [7362632] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} time: 00:22:28 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362632/ [7362633] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:19:18 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362633/ [7362634] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} time: 00:25:21 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362634/ [7362635] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} time: 00:15:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362635/ [7362636] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} time: 00:34:42 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362636/ [7362638] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:33:45 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362638/ [7362639] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} time: 01:01:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362639/ [7362640] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:17:17 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362640/ [7362641] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} time: 00:54:17 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362641/ [7362642] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} time: 00:27:01 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362642/ [7362643] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:43:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362643/ [7362644] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:24:52 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362644/ [7362646] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:46:47 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362646/ [7362647] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:47:58 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362647/ [7362648] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} time: 00:45:38 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362648/ [7362649] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:19:36 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362649/ [7362650] fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health} time: 00:24:31 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362650/ [7362652] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 01:03:09 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362652/ [7362654] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:21:35 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362654/ [7362655] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:51:58 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362655/ [7362656] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:21:10 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362656/ [7362657] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} time: 00:55:30 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362657/ [7362658] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:34:27 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362658/ [7362659] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} time: 00:40:38 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362659/ [7362660] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsync-tester}} time: 00:40:42 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362660/ [7362661] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:22:00 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362661/ [7362662] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:26:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362662/ [7362663] fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:19:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362663/ [7362664] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} time: 00:27:12 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362664/ [7362665] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:21:26 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362665/ [7362666] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-workload/new_ops/{0-clients/kclient 1-client-sanity}}} time: 00:22:26 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362666/ [7362667] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} time: 00:35:32 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362667/ [7362668] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} time: 00:41:01 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362668/ [7362669] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:24:48 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362669/ [7362670] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} time: 01:48:49 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362670/ [7362671] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} time: 00:14:45 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362671/ [7362672] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} time: 00:24:28 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362672/ [7362673] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} time: 01:11:13 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362673/ [7362674] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:28:25 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362674/ [7362675] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:20:51 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362675/ [7362677] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:27:21 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362677/ [7362678] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} time: 00:40:05 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362678/ [7362679] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:29:45 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362679/ [7362680] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} time: 00:16:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362680/ [7362682] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 00:53:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362682/ [7362685] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 01:19:47 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362685/ [7362686] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:38:17 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362686/ [7362687] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} time: 02:25:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362687/ [7362688] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} time: 00:34:51 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362688/ [7362689] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:19:43 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362689/ [7362690] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:38:44 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362690/ [7362691] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/iozone}} time: 00:39:31 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362691/ [7362692] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} time: 00:24:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362692/ [7362693] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:25:28 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362693/ [7362694] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:20:41 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362694/ [7362695] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} time: 00:19:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362695/ [7362696] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} time: 01:18:57 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362696/ [7362697] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} time: 00:17:28 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362697/ [7362698] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} time: 00:26:25 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362698/ [7362700] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:20:23 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362700/ [7362702] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:20:44 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362702/ [7362703] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:19:51 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362703/ [7362705] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:18:03 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362705/ [7362706] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:39:01 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362706/ [7362707] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} time: 00:15:36 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362707/ [7362710] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} time: 00:39:35 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362710/ [7362711] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} time: 00:28:03 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362711/ [7362712] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:21:31 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362712/ [7362715] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:05:24 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362715/ [7362716] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} time: 00:21:14 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362716/ [7362717] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} time: 00:20:20 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362717/ [7362718] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:47:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362718/ [7362719] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:40:56 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362719/ [7362720] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/misc}} time: 00:42:53 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362720/ [7362721] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:28:44 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362721/ [7362722] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 01:50:02 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362722/ [7362723] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 01:28:37 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362723/ [7362724] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:22:21 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362724/ [7362725] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:23:23 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362725/ [7362726] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:39:04 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362726/ [7362727] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir} time: 00:20:44 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362727/ [7362728] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} time: 01:33:33 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362728/ [7362729] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} time: 00:31:53 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362729/ [7362731] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:24:16 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362731/ [7362732] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} time: 00:34:18 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362732/ [7362733] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} time: 00:19:29 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362733/ [7362734] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:26:40 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362734/ [7362735] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:34:34 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362735/ [7362736] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} time: 00:20:03 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362736/ [7362738] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} time: 00:16:34 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362738/ [7362739] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:20:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362739/ [7362740] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} time: 01:57:04 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362740/ [7362741] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} time: 00:21:08 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362741/ [7362742] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:23:07 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362742/ [7362743] fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} time: 00:18:14 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362743/ [7362744] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host} time: 00:51:02 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362744/ [7362746] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} time: 00:21:57 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362746/ [7362747] fs/mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} time: 02:10:10 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362747/ [7362748] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:25:47 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362748/ [7362749] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 01:01:30 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362749/ [7362750] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 01:33:54 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362750/ [7362751] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:26:22 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362751/ [7362752] fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} time: 00:52:54 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362752/ [7362753] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:14:02 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362753/ [7362754] fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/fstop} time: 00:21:13 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362754/ [7362756] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} time: 00:19:11 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362756/ [7362757] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:29:53 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362757/ [7362760] fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:24:03 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362760/ [7362761] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:37:43 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362761/ [7362762] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:21:50 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362762/ [7362763] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:17:23 info: http://pulpito.ceph.com/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362763/