Found 252 jobs
Ignoring malparsed backtrace:  ceph version 16.0.0-8782-g07b169f7 (07b169f75941f1cb7a6c54bf9635b099f49a6647) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe1) [0x564056fa2ac9]
,  2: (KernelDevice::_aio_thread()+0xbb9) [0x564057a76249]

Ignoring malparsed backtrace: 2021-01-08T09:04:48.153+0000 7f9ee8a16700  1 -- 172.21.15.86:0/1930975866 learned_addr learned my addr 172.21.15.86:0/1930975866 (peer_addr_for_me v2:172.21.15.86:0/0)
, 2021-01-08T09:04:48.153+0000 7f9ef9704740  1 --2- 172.21.15.86:0/1930975866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x12c7c70 0x12c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:04:48.153+0000 7f9ef9704740  1 --2- 172.21.15.86:0/1930975866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x12c8b60 0x12c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:04:48.349+0000 7f9ef9704740  1 -- 172.21.15.86:0/3253551218 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ed400ec40 con 0xff4bc0
, 2021-01-08T09:04:48.349+0000 7f9ec2ffd700  1 -- 172.21.15.86:0/3253551218 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f9ed8017c80 con 0xff4bc0
, 2021-01-08T09:04:48.353+0000 7f9ec2ffd700  1 -- 172.21.15.86:0/3253551218 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed8017e80 con 0xff4bc0

Ignoring malparsed backtrace: 2021-01-08T09:04:49.793+0000 7f1e8be77740  1  Processor -- start
, 2021-01-08T09:04:49.793+0000 7f1e76ffd700  1 --2- 172.21.15.86:0/4035997565 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f1e5807f890 0x7f1e58081d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:04:49.793+0000 7f1e8be77740  1 --  start start

Ignoring malparsed backtrace: 2021-01-08T09:04:49.833+0000 7f1e76ffd700  1 -- 172.21.15.86:0/1229253063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2c74d10 msgr2=0x2c2f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
, 2021-01-08T09:04:49.833+0000 7f1e76ffd700  1 --2- 172.21.15.86:0/1229253063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2c74d10 0x2c2f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:04:49.833+0000 7f1e76ffd700  1 -- 172.21.15.86:0/1229253063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2c75c00 msgr2=0x2c81750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down

Ignoring malparsed backtrace: 2021-01-08T09:04:50.465+0000 7f686a19c700  1 --2- 172.21.15.86:0/3110072613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68640bbf10 0x7f68640642f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f685c00d2f0 tx=0x7f685c00b530).ready entity=mon.1 client_cookie=ea6f7d4f515d6871 server_cookie=0 in_seq=0 out_seq=0
, 2021-01-08T09:04:50.521+0000 7f6868999700  1 -- 172.21.15.86:0/3110072613 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c012770 con 0x7f68640bbf10
, 2021-01-08T09:04:50.521+0000 7f6868999700  1 -- 172.21.15.86:0/3110072613 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0128d0 con 0x7f68640bbf10

Ignoring malparsed backtrace: 2021-01-08T09:04:50.597+0000 7f687a689740 20 client.5676 populate_metadata read hostname 'smithi086'
, 2021-01-08T09:04:50.597+0000 7f687a689740  1 --2- 172.21.15.86:0/1989796248 >> [v2:172.21.15.86:6832/2682481779,v1:172.21.15.86:6833/2682481779] conn(0x2177db0 0x2178190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:04:50.597+0000 7f687a689740  4 client.5676 mds_command: new command op to 4316 tid=0[{"prefix": "get_command_descriptions"}]

Ignoring malparsed backtrace: 2021-01-08T09:04:50.749+0000 7f687a689740  1 --2- 172.21.15.86:0/292872274 >> [v2:172.21.15.86:6832/2682481779,v1:172.21.15.86:6833/2682481779] conn(0x21b9ef0 0x21c6740 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:04:50.749+0000 7f687a689740  1 --2- 172.21.15.86:0/292872274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x1ee4bc0 0x2174a90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:04:50.749+0000 7f687a689740  1 --2- 172.21.15.86:0/292872274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x21b8b60 0x221e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:05:22.205+0000 7fc7d27fc700  1 --2- 172.21.15.86:0/2566241147 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7fc7cc07fa20 0x7fc7cc081ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:05:22.205+0000 7fc7d27fc700  1 -- 172.21.15.86:0/2566241147 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fc7e00a2d90 con 0x7fc7e4061080
, 2021-01-08T09:05:22.205+0000 7fc7eaa02700  1 --2- 172.21.15.86:0/2566241147 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7fc7cc07fa20 0x7fc7cc081ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0

Ignoring malparsed backtrace: 2021-01-08T09:05:22.493+0000 7fc7faeef740  1 --  start start
, 2021-01-08T09:05:22.493+0000 7fc7faeef740  1  Processor -- start
, 2021-01-08T09:05:22.493+0000 7fc7faeef740  1 --2-  >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x1071bc0 0x1353e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:05:24.161+0000 7f50e9fbb700  1 --  --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c33a0 con 0x7f50e40681c0
, 2021-01-08T09:05:24.161+0000 7f50e9fbb700  1 --  --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c3640 con 0x7f50e4063f10
, 2021-01-08T09:05:24.161+0000 7f50e3fff700  1 --2-  >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50e40681c0 0x7f50e41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0

Ignoring malparsed backtrace: 2021-01-08T09:05:24.253+0000 7f50f9ca7740  1 -- 172.21.15.86:0/3557874220 >> 172.21.15.86:0/3557874220 conn(0x1e50de0 msgr2=0x1fd2cd0 unknown :-1 s=STATE_NONE l=0).mark_down
, 2021-01-08T09:05:24.253+0000 7f50c2ffd700  0 client.5686 ms_handle_reset on v2:172.21.15.86:6832/2682481779
, 2021-01-08T09:05:24.253+0000 7f50f9ca7740  1 -- 172.21.15.86:0/3557874220 shutdown_connections

Ignoring malparsed backtrace: 2021-01-08T09:05:24.397+0000 7f50e9fbb700  1 --2- 172.21.15.86:0/871671239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50e40681c0 0x7f50e41461f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:05:24.397+0000 7f50e9fbb700  1 -- 172.21.15.86:0/871671239 >> 172.21.15.86:0/871671239 conn(0x7f50e4065c60 msgr2=0x7f50e40bcee0 unknown :-1 s=STATE_NONE l=0).mark_down
, 2021-01-08T09:05:24.397+0000 7f50e9fbb700  1 -- 172.21.15.86:0/871671239 shutdown_connections

Ignoring malparsed backtrace: 2021-01-08T09:05:24.869+0000 7fdd93fff700  1 -- 172.21.15.86:0/2751538652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0xe0bb70 msgr2=0xe13410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
, 2021-01-08T09:05:24.869+0000 7fdd93fff700  1 --2- 172.21.15.86:0/2751538652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0xe0bb70 0xe13410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:05:24.869+0000 7fdd93fff700  1 -- 172.21.15.86:0/2751538652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd07ad0 con 0xe0ac80

Ignoring malparsed backtrace: 2021-01-08T09:05:25.013+0000 7fdda947a740 10 client.5707 fetch_fsmap learned FSMap version 6
, 2021-01-08T09:05:25.013+0000 7fdda947a740  1 -- 172.21.15.86:0/3256387957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({fsmap=6}) v3 -- 0xb05fe0 con 0xe0ac80
, 2021-01-08T09:05:25.013+0000 7fdd727fc700  1 -- 172.21.15.86:0/3256387957 <== mon.1 v2:172.21.15.125:3300/0 4 ==== fsmap(e 6) v1 ==== 1449+0+0 (secure 0 0 0) 0x7fdd840a0700 con 0xe0ac80

Ignoring malparsed backtrace: 2021-01-08T09:05:55.780+0000 7fc96b243700  1 -- 172.21.15.86:0/4267945089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640bcc60 con 0x7fc9640c0270
, 2021-01-08T09:05:55.780+0000 7fc96b243700  1 -- 172.21.15.86:0/4267945089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9640bd1a0 con 0x7fc9640c0270
, 2021-01-08T09:05:55.788+0000 7fc979ccd740  1  Processor -- start

Ignoring malparsed backtrace: 2021-01-08T09:05:55.948+0000 7fc9697e0700  1 --2- 172.21.15.86:0/549066933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x248cb60 0x248d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:05:55.948+0000 7fc963fff700  1 -- 172.21.15.86:0/549066933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x248cb60 msgr2=0x248d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
, 2021-01-08T09:05:55.948+0000 7fc963fff700  1 --2- 172.21.15.86:0/549066933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x248cb60 0x248d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:05:57.516+0000 7f2302647700  1 --2- 172.21.15.86:0/3547921638 >> v2:172.21.15.86:3300/0 conn(0x7f22fc0c7f90 0x7f22fc0c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:05:57.516+0000 7f2302e48700  1 -- 172.21.15.86:0/3547921638 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0c1f20 con 0x7f22fc0c7f90
, 2021-01-08T09:05:57.516+0000 7f2302e48700  1 -- 172.21.15.86:0/3547921638 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0bfd50 con 0x7f22fc0c7bb0

Ignoring malparsed backtrace: 2021-01-08T09:05:57.624+0000 7f2301e46700  1 -- 172.21.15.86:0/1326299473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2384d10 msgr2=0x2387d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
, 2021-01-08T09:05:57.624+0000 7f2301e46700  1 --2- 172.21.15.86:0/1326299473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2384d10 0x2387d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:05:57.624+0000 7f2301e46700  1 -- 172.21.15.86:0/1326299473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2292b70 con 0x20b1c60

Ignoring malparsed backtrace: 2021-01-08T09:05:57.768+0000 7f2312b34740 10 client.5743 fetch_fsmap finished waiting for FSMap version 6
, 2021-01-08T09:05:57.768+0000 7f2312b34740 10 client.5743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a
, 2021-01-08T09:05:57.768+0000 7f2312b34740 20 client.5743 populate_metadata read hostname 'smithi086'

Ignoring malparsed backtrace: 2021-01-08T09:05:58.048+0000 7f829ad9d700  1 --2- 172.21.15.86:0/923741269 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f827807f870 0x7f8278081d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:05:58.048+0000 7f829ad9d700  1 --2- 172.21.15.86:0/923741269 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f827807f870 0x7f8278081d30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f8294004250 tx=0x7f8294007d30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
, 2021-01-08T09:05:58.048+0000 7f82af8af740  1 --2-  >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x25e6bc0 0x2874c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:05:58.080+0000 7f8299d9b700  1 --2- 172.21.15.86:0/2293407823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x28c8e60 0x287d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:05:58.080+0000 7f8299d9b700  1 -- 172.21.15.86:0/2293407823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c14cb30 con 0x28b9c70
, 2021-01-08T09:05:58.080+0000 7f829ad9d700  1 --2- 172.21.15.86:0/2293407823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x28c8e60 0x287d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!

Ignoring malparsed backtrace: 2021-01-08T09:06:10.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s
, 2021-01-08T09:06:17.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~7s
, 2021-01-08T09:06:24.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~14s

Ignoring malparsed backtrace: 2021-01-08T09:06:28.367+0000 7fbe3bfff700  1 --2-  >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0xfafc70 0xf6e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:06:28.367+0000 7fbe409ea700  1 --2-  >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0xcdcbc0 0xfbf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52598/0 (socket says 172.21.15.86:52598)
, 2021-01-08T09:06:28.367+0000 7fbe409ea700  1 -- 172.21.15.86:0/1606199446 learned_addr learned my addr 172.21.15.86:0/1606199446 (peer_addr_for_me v2:172.21.15.86:0/0)

Ignoring malparsed backtrace: 2021-01-08T09:06:28.399+0000 7fbe516d8740  1 -- 172.21.15.86:0/3675119523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xfc5480 con 0xfb0b60
, 2021-01-08T09:06:28.399+0000 7fbe1affd700  1 -- 172.21.15.86:0/3675119523 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28022070 con 0xfb0b60
, 2021-01-08T09:06:28.399+0000 7fbe1affd700  1 -- 172.21.15.86:0/3675119523 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 6) v1 ==== 1449+0+0 (secure 0 0 0) 0x7fbe34085030 con 0xfb0b60

Ignoring malparsed backtrace: 2021-01-08T09:06:32.171+0000 7f81dce64700  1 --2-  >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d80bef30 0x7f81d8164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:06:32.171+0000 7f81dce64700  1 --2-  >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81d80bef30 0x7f81d8164be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.86:38982/0 (socket says 172.21.15.86:38982)
, 2021-01-08T09:06:32.171+0000 7f81dce64700  1 -- 172.21.15.86:0/3300448295 learned_addr learned my addr 172.21.15.86:0/3300448295 (peer_addr_for_me v2:172.21.15.86:0/0)

Ignoring malparsed backtrace: 2021-01-08T09:06:33.147+0000 7fc0eb59e700  1 --2- 172.21.15.86:0/228033782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0ec0c1a00 0x7fc0ec156c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fc0e400eb80 tx=0x7fc0e40091d0).stop
, 2021-01-08T09:06:33.147+0000 7fc0eb59e700  1 -- 172.21.15.86:0/228033782 shutdown_connections
, 2021-01-08T09:06:33.147+0000 7fc0eb59e700  1 --2- 172.21.15.86:0/228033782 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7fc0d007fa60 0x7fc0d0081f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:06:53.875+0000 7fd1cffff700  1 -- 172.21.15.86:0/3874891469 >> v2:172.21.15.156:3300/0 conn(0x7fd1d00bc340 msgr2=0x7fd1d0061760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
, 2021-01-08T09:06:53.875+0000 7fd1cffff700  1 --2- 172.21.15.86:0/3874891469 >> v2:172.21.15.156:3300/0 conn(0x7fd1d00bc340 0x7fd1d0061760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:06:53.875+0000 7fd1cffff700  1 -- 172.21.15.86:0/3874891469 >> v2:172.21.15.86:3300/0 conn(0x7fd1d00bcbc0 msgr2=0x7fd1d00bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down

Ignoring malparsed backtrace: 2021-01-08T09:06:54.291+0000 7efc0122a700  1 --2-  >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efbfc14d280 0x7efbfc14c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:06:54.291+0000 7efc0122a700  1 --  --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc161f30 con 0x7efbfc14d280
, 2021-01-08T09:06:54.291+0000 7efc0122a700  1 --  --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc15f010 con 0x7efbfc14f280

Ignoring malparsed backtrace: 2021-01-08T09:07:14.682+0000 7fbfeccfd700  1 -- 172.21.15.86:0/1284451358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8152ae0 con 0x7fbfe8067800
, 2021-01-08T09:07:14.682+0000 7fbfde7fc700  1 -- 172.21.15.86:0/1284451358 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 6) v1 ==== 100775+0+0 (secure 0 0 0) 0x7fbfd0010070 con 0x7fbfe8067800
, 2021-01-08T09:07:14.686+0000 7fbfde7fc700  1 --2- 172.21.15.86:0/1284451358 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7fbfcc07f870 0x7fbfcc081d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:07:35.486+0000 7f874759e700  1  Processor -- start
, 2021-01-08T09:07:35.486+0000 7f874759e700  1 --  start start
, 2021-01-08T09:07:35.490+0000 7f874759e700  1 --2-  >> v2:172.21.15.125:3300/0 conn(0x7f8748063040 0x7f8748063420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:07:35.902+0000 7f7375493700  1 --2- 172.21.15.86:0/3865711946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7370065330 0x7f7370063330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f736000b980 tx=0x7f7360006de0).stop
, 2021-01-08T09:07:35.902+0000 7f7375493700  1 -- 172.21.15.86:0/3865711946 shutdown_connections
, 2021-01-08T09:07:35.902+0000 7f7375493700  1 --2- 172.21.15.86:0/3865711946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7370065330 0x7f7370063330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:07:56.301+0000 7fee84278700  1 -- 172.21.15.86:0/2966313352 >> 172.21.15.86:0/2966313352 conn(0x7fee7c065c10 msgr2=0x7fee7c0c7c30 unknown :-1 s=STATE_NONE l=0).mark_down
, 2021-01-08T09:07:56.301+0000 7fee84278700  1 -- 172.21.15.86:0/2966313352 shutdown_connections
, 2021-01-08T09:07:56.301+0000 7fee84278700  1 -- 172.21.15.86:0/2966313352 wait complete.

Ignoring malparsed backtrace: 2021-01-08T09:07:56.725+0000 7f2dccff9700  1 -- 172.21.15.86:0/270772618 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 6) v1 ==== 100775+0+0 (secure 0 0 0) 0x7f2dc4010030 con 0x7f2dd00658a0
, 2021-01-08T09:07:56.725+0000 7f2dccff9700  1 --2- 172.21.15.86:0/270772618 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f2db007f840 0x7f2db0081d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:07:56.725+0000 7f2dccff9700  1 -- 172.21.15.86:0/270772618 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f2dc40a19a0 con 0x7f2dd00658a0

Ignoring malparsed backtrace: 2021-01-08T09:08:17.513+0000 7f6d5a4a5700  1 --2-  >> v2:172.21.15.125:3300/0 conn(0x7f6d540c00e0 0x7f6d540c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:08:17.513+0000 7f6d5a4a5700  1 --2-  >> v2:172.21.15.86:3300/0 conn(0x7f6d540bb780 0x7f6d54068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:08:17.513+0000 7f6d5a4a5700  1 --  --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d54067640 con 0x7f6d540bb2f0

Ignoring malparsed backtrace: 2021-01-08T09:08:37.900+0000 7f900aaad700  1 --2- 172.21.15.86:0/3534228017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90040bb7b0 0x7f90040bbb90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f9004066ea0 tx=0x7f9000006ea0).stop
, 2021-01-08T09:08:37.900+0000 7f900aaad700  1 -- 172.21.15.86:0/3534228017 shutdown_connections
, 2021-01-08T09:08:37.900+0000 7f900aaad700  1 --2- 172.21.15.86:0/3534228017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90040bb7b0 0x7f90040bbb90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:08:38.324+0000 7efca99f7700  1 -- 172.21.15.86:0/203932749 >> 172.21.15.86:0/203932749 conn(0x7efca405bd20 msgr2=0x7efca40badf0 unknown :-1 s=STATE_NONE l=0).mark_down
, 2021-01-08T09:08:38.324+0000 7efca99f7700  1 -- 172.21.15.86:0/203932749 shutdown_connections
, 2021-01-08T09:08:38.324+0000 7efca99f7700  1 -- 172.21.15.86:0/203932749 wait complete.

Ignoring malparsed backtrace: 2021-01-08T09:08:58.720+0000 7fa5db37f700  1  Processor -- start
, 2021-01-08T09:08:58.724+0000 7fa5db37f700  1 --  start start
, 2021-01-08T09:08:58.724+0000 7fa5db37f700  1 --2-  >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0044d0 0x7fa5d4156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:08:59.128+0000 7fe42dffb700  1 -- 172.21.15.86:0/3387339600 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fe4380a2e60 con 0x7fe4401517c0
, 2021-01-08T09:08:59.128+0000 7fe445d8c700  1 --2- 172.21.15.86:0/3387339600 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7fe42007f840 0x7fe420081d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
, 2021-01-08T09:08:59.128+0000 7fe445d8c700  1 --2- 172.21.15.86:0/3387339600 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7fe42007f840 0x7fe420081d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fe43c0036c0 tx=0x7fe43c000b80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0

Ignoring malparsed backtrace: 2021-01-08T09:09:19.931+0000 7ff3018cb700  1 --2-  >> v2:172.21.15.125:3300/0 conn(0x7ff2fc0bf9c0 0x7ff2fc0bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:09:19.931+0000 7ff3018cb700  1 --  --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc151c90 con 0x7ff2fc0bba70
, 2021-01-08T09:09:19.931+0000 7ff3018cb700  1 --  --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc151f30 con 0x7ff2fc151610

Ignoring malparsed backtrace: 2021-01-08T09:09:40.351+0000 7fe44d0c0700  1 --2- 172.21.15.86:0/3751933682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe44814c920 0x7fe4480bcec0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:09:40.351+0000 7fe44d0c0700  1 -- 172.21.15.86:0/3751933682 >> 172.21.15.86:0/3751933682 conn(0x7fe4480c3870 msgr2=0x7fe4480c3c80 unknown :-1 s=STATE_NONE l=0).mark_down
, 2021-01-08T09:09:40.351+0000 7fe44d0c0700  1 -- 172.21.15.86:0/3751933682 shutdown_connections

Ignoring malparsed backtrace: 2021-01-08T09:09:40.779+0000 7ffb133fb700  1 --  start start
, 2021-01-08T09:09:40.779+0000 7ffb133fb700  1 --2-  >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaf4004fd0 0x7ffb0c0bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:09:40.779+0000 7ffb133fb700  1 --2-  >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb0c0bb870 0x7ffb0c143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:10:01.202+0000 7fbf8cff9700  1 -- 172.21.15.86:0/3985092902 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80011d10 con 0x7fbf90080cc0
, 2021-01-08T09:10:01.202+0000 7fbf95496700  1 -- 172.21.15.86:0/3985092902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf901134e0 con 0x7fbf90080cc0
, 2021-01-08T09:10:01.202+0000 7fbf8cff9700  1 -- 172.21.15.86:0/3985092902 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8001d660 con 0x7fbf90080cc0

Ignoring malparsed backtrace: 2021-01-08T09:10:01.826+0000 7fc00effd700  1 -- 172.21.15.86:0/2721824771 wait complete.
, 2021-01-08T09:10:01.861 INFO:tasks.ceph:Waiting for all PGs to be active+clean and split+merged, waiting on ['4.2', '4.7', '3.0', '2.0', '4.3', '3.4'] to go clean
, 2021-01-08T09:10:02.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~232s

Ignoring malparsed backtrace: 2021-01-08T09:10:22.486+0000 7f9855351700  1 -- 172.21.15.86:0/3218735483 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500610a0 con 0x7f9850067800
, 2021-01-08T09:10:22.486+0000 7f9855351700  1 --2- 172.21.15.86:0/3218735483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9850067800 0x7f98500617e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f98500babb0 tx=0x7f9848006de0).ready entity=mon.1 client_cookie=230feb0cc7e1fe60 server_cookie=0 in_seq=0 out_seq=0
, 2021-01-08T09:10:22.486+0000 7f98477fe700  1 -- 172.21.15.86:0/3218735483 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848009640 con 0x7f9850067800

Ignoring malparsed backtrace: 2021-01-08T09:10:42.913+0000 7ff9abfff700  1 --2- 172.21.15.86:0/4096219519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff98c004f80 0x7ff98c00fb30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7ff9a4001fa0 tx=0x7ff9a4007f00).ready entity=mon.2 client_cookie=1401704184dc4d9b server_cookie=0 in_seq=0 out_seq=0
, 2021-01-08T09:10:42.913+0000 7ff9a9ffb700  1 -- 172.21.15.86:0/4096219519 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4001670 con 0x7ff98c004f80
, 2021-01-08T09:10:42.913+0000 7ff9a9ffb700  1 -- 172.21.15.86:0/4096219519 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400cb10 con 0x7ff98c004f80

Ignoring malparsed backtrace: 2021-01-08T09:10:43.341+0000 7f6e9e59c700  1 -- 172.21.15.86:0/434985593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ea814c540 msgr2=0x7f6ea81520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
, 2021-01-08T09:10:43.341+0000 7f6e9e59c700  1 --2- 172.21.15.86:0/434985593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ea814c540 0x7f6ea81520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:10:43.341+0000 7f6e9e59c700  1 -- 172.21.15.86:0/434985593 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea814f280 msgr2=0x7f6ea81645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down

Ignoring malparsed backtrace: 2021-01-08T09:11:03.959 INFO:teuthology.orchestra.run.smithi086.stdout:
, 2021-01-08T09:11:03.961+0000 7f4c0151d700  1 -- 172.21.15.86:0/3860466551 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f4bdc07f890 msgr2=0x7f4bdc081d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
, 2021-01-08T09:11:03.961+0000 7f4c0151d700  1 --2- 172.21.15.86:0/3860466551 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f4bdc07f890 0x7f4bdc081d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f4bec00b130 tx=0x7f4bec016000).stop

Ignoring malparsed backtrace: 2021-01-08T09:11:04.361+0000 7f6b9de03700  1 -- 172.21.15.86:0/303662706 shutdown_connections
, 2021-01-08T09:11:04.361+0000 7f6b9de03700  1 --2- 172.21.15.86:0/303662706 >> [v2:172.21.15.125:6808/19763,v1:172.21.15.125:6809/19763] conn(0x7f6b7c07f890 0x7f6b7c081d50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop
, 2021-01-08T09:11:04.361+0000 7f6b9de03700  1 --2- 172.21.15.86:0/303662706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b980bb070 0x7f6b980bcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:11:24.800+0000 7f7b5affd700  1 --2-  >> v2:172.21.15.156:3300/0 conn(0x7f7b5c065710 0x7f7b5c0bd800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000
, 2021-01-08T09:11:25.204+0000 7f7b5b7fe700  1 --  >> v2:172.21.15.86:3300/0 conn(0x7f7b5c065330 msgr2=0x7f7b5c063330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:3300/0
, 2021-01-08T09:11:25.204+0000 7f7b5bfff700  1 --  >> v1:172.21.15.86:6789/0 conn(0x7f7b5c067800 legacy=0x7f7b5c067c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.86:6789/0

Ignoring malparsed backtrace: 2021-01-08T09:11:36.600+0000 7f7b597fa700  1 --  --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0bb370 con 0x7f7b5c065710
, 2021-01-08T09:11:36.600+0000 7f7b5affd700  1 --  >> v2:172.21.15.156:3300/0 conn(0x7f7b5c065710 msgr2=0x7f7b3c005f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0
, 2021-01-08T09:11:36.600+0000 7f7b5b7fe700  1 --  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c00e550 msgr2=0x7f7b3c00d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0

Ignoring malparsed backtrace: 2021-01-08T09:11:47.016+0000 7f7b5affd700  1 --2-  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c00e550 0x7f7b3c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000
, 2021-01-08T09:11:48.604+0000 7f7b597fa700  1 --  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c00e550 msgr2=0x7f7b3c00d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
, 2021-01-08T09:11:48.604+0000 7f7b597fa700  1 --2-  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c00e550 0x7f7b3c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop

Ignoring malparsed backtrace: 2021-01-08T09:11:57.811+0000 7f7b5affd700  1 --  >> v1:172.21.15.86:6789/0 conn(0x7f7b3c01a460 legacy=0x7f7b3c00ee60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.86:6789/0
, 2021-01-08T09:11:57.811+0000 7f7b5b7fe700  1 --  >> v1:172.21.15.156:6789/0 conn(0x7f7b3c019040 legacy=0x7f7b3c017eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0
, 2021-01-08T09:11:57.811+0000 7f7b5bfff700  1 --  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c0057f0 msgr2=0x7f7b3c008570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0

Ignoring malparsed backtrace: 2021-01-08T09:12:09.607+0000 7f7b597fa700  1 --  >> v1:172.21.15.156:6789/0 conn(0x7f7b3c005f20 legacy=0x7f7b3c017e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down
, 2021-01-08T09:12:09.607+0000 7f7b597fa700  1 --2-  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c019f50 0x7f7b3c015d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:12:09.607+0000 7f7b597fa700  1 --  --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c14f0c0 con 0x7f7b3c00f350

Ignoring malparsed backtrace: 2021-01-08T09:12:20.023+0000 7f7b5bfff700  1 --  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c00dda0 msgr2=0x7f7b3c0057b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0
, 2021-01-08T09:12:20.023+0000 7f7b5affd700  1 --  >> v2:172.21.15.86:3300/0 conn(0x7f7b3c00d2a0 msgr2=0x7f7b3c009570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:3300/0
, 2021-01-08T09:12:20.023+0000 7f7b5bfff700  1 --2-  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c00dda0 0x7f7b3c0057b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000

Ignoring malparsed backtrace: 2021-01-08T09:12:30.611+0000 7f7b5affd700  1 --2-  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c00d2a0 0x7f7b3c019980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000
, 2021-01-08T09:12:30.815+0000 7f7b5affd700  1 --  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c00d2a0 msgr2=0x7f7b3c019980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0
, 2021-01-08T09:12:30.815+0000 7f7b5bfff700  1 --  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c00f350 msgr2=0x7f7b3c019e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0

Ignoring malparsed backtrace: 2021-01-08T09:12:42.614+0000 7f7b5bfff700  1 --  reap_dead start
, 2021-01-08T09:12:42.614+0000 7f7b597fa700  1 --2-  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c005f20 0x7f7b3c019980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
, 2021-01-08T09:12:42.614+0000 7f7b597fa700  1 --2-  >> v2:172.21.15.86:3300/0 conn(0x7f7b3c00f350 0x7f7b3c019e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect

Ignoring malparsed backtrace: 2021-01-08T09:12:52.218+0000 7f7b5bfff700  1 --  >> v1:172.21.15.156:6789/0 conn(0x7f7b3c013ce0 legacy=0x7f7b3c0160d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0
, 2021-01-08T09:12:53.022+0000 7f7b5affd700  1 --  >> v1:172.21.15.86:6789/0 conn(0x7f7b3c01ad30 legacy=0x7f7b3c01b140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.86:6789/0
, 2021-01-08T09:12:53.022+0000 7f7b5bfff700  1 --  >> v1:172.21.15.156:6789/0 conn(0x7f7b3c013ce0 legacy=0x7f7b3c0160d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0

Ignoring malparsed backtrace: 2021-01-08T09:13:03.822+0000 7f7b5b7fe700  1 --  >> v1:172.21.15.156:6789/0 conn(0x7f7b3c00f2d0 legacy=0x7f7b3c0170e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0
, 2021-01-08T09:13:03.822+0000 7f7b5bfff700  1 --2-  >> v2:172.21.15.86:3300/0 conn(0x7f7b3c01b350 0x7f7b3c0177f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000
, 2021-01-08T09:13:03.822+0000 7f7b5affd700  1 --  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c018e50 msgr2=0x7f7b3c009510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0

Ignoring malparsed backtrace: 2021-01-08T09:13:15.618+0000 7f7b5affd700  1 --  >> v2:172.21.15.86:3300/0 conn(0x7f7b3c009520 msgr2=0x7f7b3c00eb90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:3300/0
, 2021-01-08T09:13:15.618+0000 7f7b5b7fe700  1 --  >> v2:172.21.15.125:3300/0 conn(0x7f7b3c01b350 msgr2=0x7f7b3c00e6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0
, 2021-01-08T09:13:15.618+0000 7f7b5bfff700  1 --2-  >> v2:172.21.15.156:3300/0 conn(0x7f7b3c015cf0 0x7f7b3c016100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000

Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 183, in _raise_for_status
,     node=self.hostname, label=self.label
, teuthology.exceptions.CommandFailedError: Command failed on smithi086 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20210107.220115/qa/tasks/ceph.py", line 1212, in osd_scrub_pgs
,     stats = manager.get_pg_stats()
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20210107.220115/qa/tasks/ceph_manager.py", line 2101, in get_pg_stats

Ignoring malparsed backtrace: 2021-01-08T09:13:26.082 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9
, 2021-01-08T09:13:26.448 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi156.front.sepia.ceph.com
, 2021-01-08T09:13:26.449 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1

Ignoring malparsed backtrace:     yield vars
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 619, in task
,     yield

Ignoring malparsed backtrace: Traceback (most recent call last):
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 365, in archive
,     yield